-- Logs begin at Thu 2022-09-01 16:52:37 UTC, end at Thu 2022-09-01 17:57:59 UTC. -- Sep 01 17:27:56.197048 dv-cinder-839768-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 17:27:56.206467 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 17:27:56.209187 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 17:27:56 2022] *** Sep 01 17:27:56.209187 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 17:27:56.209187 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 17:27:56.209187 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: nodename: dv-cinder-839768-6-iscsi Sep 01 17:27:56.209187 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: machine: x86_64 Sep 01 17:27:56.209187 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: clock source: unix Sep 01 17:27:56.209187 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: pcre jit disabled Sep 01 17:27:56.209187 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: detected number of CPU cores: 4 Sep 01 17:27:56.209187 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: current working directory: / Sep 01 17:27:56.209187 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: detected binary path: /usr/bin/uwsgi-core Sep 01 17:27:56.209187 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: your processes number limit is 47680 Sep 01 17:27:56.209187 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: your memory page size is 4096 bytes Sep 01 17:27:56.209187 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: detected max file descriptor number: 2048 Sep 01 17:27:56.210116 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: lock engine: pthread robust mutexes Sep 01 17:27:56.210116 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: thunder lock: enabled Sep 01 17:27:56.210116 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 17:27:56.210116 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 17:27:56.250957 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: Python main interpreter initialized at 0x55bc22ee69c0 Sep 01 17:27:56.250957 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: python threads support enabled Sep 01 17:27:56.250957 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: your server socket listen backlog is limited to 100 connections Sep 01 17:27:56.250957 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: your mercy for graceful operations on workers is 90 seconds Sep 01 17:27:56.251554 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 17:27:56.251554 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: *** Operational MODE: preforking *** Sep 01 17:27:56.251726 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: *** uWSGI is running in multiple interpreter mode *** Sep 01 17:27:56.251726 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: spawned uWSGI master process (pid: 105740) Sep 01 17:27:56.252000 dv-cinder-839768-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 17:27:56.253289 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: spawned uWSGI worker 1 (pid: 105749, cores: 1) Sep 01 17:27:56.253289 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: spawned uWSGI worker 2 (pid: 105750, cores: 1) Sep 01 17:27:56.253289 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 17:27:56.964439 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 17:27:56.967411 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 17:27:58.092913 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:27:58.092913 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: from cryptography.utils import int_from_bytes Sep 01 17:27:58.093502 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:27:58.093502 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: from cryptography.utils import int_from_bytes Sep 01 17:27:58.112877 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:27:58.112877 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: from cryptography.utils import int_from_bytes Sep 01 17:27:58.113690 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:27:58.113690 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: from cryptography.utils import int_from_bytes Sep 01 17:28:00.652646 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:28:00.653303 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:28:00.653392 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:28:00.653767 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:28:00.653841 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:28:00.653908 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:28:00.654223 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:28:00.654330 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:28:00.654488 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.654580 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:28:00.654748 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:28:00.654857 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.655105 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.655201 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.655431 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.655625 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.655756 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.656003 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.656085 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.656151 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.656368 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.656524 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.656937 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.657073 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.657313 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.658169 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.658409 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.658630 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.658630 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.659023 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.659219 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.659427 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-6-iscsi {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.659635 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.659849 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.660045 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-6-iscsi {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.660255 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.660459 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.660667 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.660897 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.661132 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.661356 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.661610 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.661828 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.663462 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.663575 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.663723 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.663809 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.663809 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.663970 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.664067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.664223 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.664317 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.664459 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.664542 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.664674 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.664771 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.664859 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.664939 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.665017 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.665171 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.665301 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.665443 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.665528 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.665683 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.665825 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.665978 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.666099 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.666248 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.666364 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.666813 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.666964 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-6-iscsi {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.667099 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-6-iscsi {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.667233 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.667373 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.667526 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.667691 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.667833 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.667935 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.668076 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.668181 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.668328 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.668437 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.668579 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.668670 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.668813 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.668898 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.669022 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.669146 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.669289 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.669447 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.669637 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.669778 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.669938 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.670080 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.670223 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.670373 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.670530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.670672 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.670814 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.670956 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.671108 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.671258 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.671417 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.671559 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.671701 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.671852 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.672007 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.672172 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.672319 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.672465 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.672611 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.672774 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.672979 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.673143 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.673299 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.673471 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.673678 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.673820 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.673960 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.674124 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.674330 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.674489 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.674631 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.674785 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.674939 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.675080 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.675249 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.675392 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.675537 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.675768 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.675914 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.676058 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.676190 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.676332 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.676475 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.676661 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.676825 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.676977 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.677118 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.677254 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.677394 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.677549 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.677718 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.677883 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.678026 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.678166 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.678309 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.678460 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.678597 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.678597 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.678850 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.678982 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.679129 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.679129 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.679365 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.679365 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.679672 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.679764 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.679976 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.680105 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.680246 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.680378 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.680510 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.680655 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.680810 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.680942 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.681070 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.681205 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.681347 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.681476 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.681561 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.681741 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.681887 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.681973 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.682051 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.682139 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.682219 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.682317 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.682463 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.682604 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.682741 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.682898 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.683100 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.683240 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.683377 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.683524 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.683716 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.683872 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.684013 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.684153 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.684297 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.684392 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.684473 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.684560 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.684641 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.684746 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.684874 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.684981 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.685086 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.685168 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.685292 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.685427 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.685622 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.685764 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.685942 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.686054 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.686255 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.686362 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.686571 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.686670 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.686882 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.687020 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.687190 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.687324 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.687499 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.687624 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.687810 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.687945 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.688126 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.688261 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.688444 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.688573 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.688777 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.688934 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.689098 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.689425 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.689596 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.689686 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.689784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.689932 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.690074 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.690205 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.690332 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.690462 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.690608 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.690760 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.690888 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.691030 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.691475 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.691632 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.691785 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.691926 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.692063 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.692327 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.692483 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.692627 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.692760 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.692891 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.693041 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.693217 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.693417 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.693636 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.693786 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.693934 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.694073 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.694216 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.694397 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.694548 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.694687 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.694824 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.694960 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.695108 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.695245 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.695402 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.695541 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.695678 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.695822 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.695960 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.696105 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.696244 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.696380 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.696518 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.696665 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.696803 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.696958 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.697097 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.697241 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.697378 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.697515 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.697686 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.697843 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.697982 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.698119 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.698256 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.698398 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.698537 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.698686 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.698842 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:28:00.698981 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.699117 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.699263 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.699412 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.699550 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.699688 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.699927 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.700073 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.700210 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.700357 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.700497 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.700646 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.700782 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.700919 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.701063 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.701225 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.701365 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.701502 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.701730 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.701874 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.702025 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.702165 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.702301 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.702447 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.702601 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.702769 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.702917 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.703064 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.703203 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.703339 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.703476 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.703638 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.703787 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.703962 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.704110 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.704839 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.705084 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.705272 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.705471 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.705639 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.705818 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.706011 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.706169 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.706316 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.706463 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.706610 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.706790 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.706938 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.707109 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.707277 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.707427 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.707715 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.707861 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.708038 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.708183 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.708357 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.708516 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.708655 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.708792 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.709003 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.709151 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.709324 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.709482 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.709650 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.709796 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.709987 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.710189 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.710369 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.710614 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.710767 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.710921 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.711040 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.711234 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.711473 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.711597 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.711911 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.712023 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.712259 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.712346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.712597 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.712701 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.712912 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.713016 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.713238 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.713360 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.713558 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.713767 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.713917 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.714205 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.714305 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.714519 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.714644 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.714838 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.714970 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.715152 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.715312 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.715459 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.715640 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.715767 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.715963 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.716066 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.716288 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.716395 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.716609 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.716697 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.716927 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.717023 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.717257 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.717440 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.717644 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.717839 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.717986 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.718125 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.718856 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.719014 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.719154 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.719423 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.719567 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.719705 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.719900 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.722166 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.722323 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.722466 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.722744 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.722894 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.722894 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.722894 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.723362 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.723543 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.723698 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.723844 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.723999 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.724146 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.724285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.724434 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.724434 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.724705 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.724845 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.724982 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.725130 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.725268 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.725405 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.725556 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.725722 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.725861 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.725998 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.726169 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.726312 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.726463 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.726611 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.726750 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.726899 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.727037 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.727182 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.727329 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.727469 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.727607 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.727744 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.727881 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.728027 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.728165 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.728342 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.728481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.728619 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.728767 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.728913 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.729061 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.729207 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.729346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.729492 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.729651 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.729813 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.729954 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.730093 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.730242 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.730381 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.730526 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.730683 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.730822 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.730959 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.731098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.731242 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.731389 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.731528 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.731666 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.731803 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.731940 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.732078 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.732358 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.732524 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.732672 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.732811 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.732948 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.733085 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.733232 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.733372 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.733509 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.733676 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.733815 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.733967 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.734116 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.734256 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.734418 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.734558 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.734696 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.734850 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.734996 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.735134 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.735272 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.735409 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.735623 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.735779 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.735920 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.736065 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.736204 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.736353 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.736491 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.736637 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.736883 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.737032 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.737170 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.737307 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.737445 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.737693 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.737693 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.737966 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.738103 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.738240 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.738400 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.738539 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.738683 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.738822 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.738959 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.739095 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.739311 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.739452 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.739597 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.739747 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.739891 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.740030 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.740176 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.740325 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.740463 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.740607 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.740745 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.740882 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.741028 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.741166 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.741302 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.741439 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.741593 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.741739 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.741889 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.742038 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.742175 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.742329 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.742542 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.742700 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.742840 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.742984 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.743123 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.743260 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.743396 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.743541 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.743682 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.743819 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.743973 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.744112 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.744249 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.744395 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.744534 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.744673 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.744822 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.744968 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.745107 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.745253 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.745391 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.745535 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.745721 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.745882 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.746030 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.746170 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.746314 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.746452 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.746589 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.746733 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.746881 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.747020 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.747157 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.747294 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.747431 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.747568 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.747723 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.747723 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.747994 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.748133 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.748278 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.748418 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.748568 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.748708 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.748846 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.748983 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.749121 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.749267 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.749406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.749554 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.749727 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.749877 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.750018 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.750164 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.750304 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.750449 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.750588 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.750739 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.750885 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.751033 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.751033 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.751342 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.751480 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.751617 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.751617 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.751887 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.752035 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.752173 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.752318 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.752457 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.752715 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.752869 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.753010 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.753149 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.753306 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.753456 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.753683 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.753833 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.753972 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.754111 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.754248 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.754470 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.754635 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.754778 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.754954 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.755106 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.755320 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.755475 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.755622 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.755768 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.755907 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.756044 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.756181 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.756320 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.756469 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.756609 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.756746 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.756884 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.757021 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.757167 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.757323 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.757469 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.757629 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.757784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.757934 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.758082 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.758221 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.758360 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.758497 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.758636 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.758781 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.758929 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.758929 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.759201 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.759339 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.759484 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.759484 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.759835 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.759977 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.760114 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.760251 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.760397 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.760553 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.760701 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.760839 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.760986 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.761123 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.761260 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.761409 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.761549 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.761718 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.761718 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.761991 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.762130 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.762276 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.762421 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.762569 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.762726 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.762973 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.763133 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.763286 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.763438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.763579 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.763718 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.763857 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.763995 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.764133 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.764280 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.764419 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.764557 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.764695 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.764695 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.764982 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.765122 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.765261 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.765399 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.765536 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.765781 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.765939 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.766079 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.766224 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.766372 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.766519 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.766667 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.767321 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.767480 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.767628 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.767767 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.767953 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.768100 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.768295 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.768452 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.768716 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.768862 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.769028 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.769176 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.769351 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.769507 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.769684 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.769844 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.769995 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.770133 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.770298 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.770454 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.770594 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.770738 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.770921 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.771068 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.771248 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.771406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.771661 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.771808 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.771956 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.772096 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.772272 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.772427 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.772597 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.772759 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.772904 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.773177 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.773342 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.773489 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.773712 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.773819 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.773910 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.773995 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.774182 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.774282 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.774497 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.774669 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.774819 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.774971 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.775119 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.775322 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.775492 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.776174 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.776344 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.776509 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.776657 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.776802 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.776955 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.777102 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.777255 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.777409 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.777556 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.777804 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.777951 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.778127 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.778289 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.778436 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.778580 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.778724 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.778869 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.779013 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.779166 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.779314 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.779466 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.779612 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.779755 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.779899 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.780062 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.780208 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.780354 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.780499 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.780642 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.780799 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.780960 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.781111 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.781256 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.781409 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.781555 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.781993 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.782142 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.782298 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.782495 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.783164 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.783400 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.783562 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.783725 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.783870 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.784014 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.784014 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.784296 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.784296 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.784584 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.784740 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.784884 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.785028 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.785172 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.785392 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.785540 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.785726 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.785882 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.786027 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.786172 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.786325 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.786473 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.786619 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.786782 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.786938 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.787096 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.787244 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.787389 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.787534 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.787679 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.787823 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.787975 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.788232 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.788397 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.788544 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.788689 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.788845 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.789004 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.789150 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.789294 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.789438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.789601 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.789770 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.789927 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.790080 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.790226 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.790383 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.790529 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.790683 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.790847 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.791007 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.791166 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.791313 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.791457 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.791617 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.791771 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.791925 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.792086 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.792086 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.792382 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.792382 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.792724 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.792882 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.793028 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.793172 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.793326 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.793597 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.793754 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.793900 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.794046 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.794201 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.794361 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.794508 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.794654 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.794810 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.794954 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.795099 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.795251 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.795404 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.795549 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.795693 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.795837 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.795981 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.796135 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.796281 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.796425 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.796569 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.796724 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.796869 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.797022 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.797169 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.797313 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.797457 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.797661 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.797833 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.797981 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.798160 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.798306 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.798450 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.798594 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.798758 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.798905 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.798905 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.799188 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.799188 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.799462 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.799620 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.799620 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.799904 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.800055 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.800208 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.800354 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.800510 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.800674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.800820 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.800971 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.801120 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.801273 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.801420 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.801587 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.801753 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.801753 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.802029 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.802182 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.802329 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.802480 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.802641 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.802795 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.802947 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.803105 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.803251 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.803396 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.803567 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.803799 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.803950 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.804109 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.804255 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.804401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.804556 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.804710 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.804865 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.805018 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.805163 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.805315 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.805462 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.805743 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.805910 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.805910 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.806189 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.806333 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.806478 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.806633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.806786 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.806944 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.807097 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.807243 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.807387 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.807530 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.807684 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.807829 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.807974 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.808117 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.808262 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.808414 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.808577 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.808730 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.808883 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.809030 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.809174 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.809327 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.809473 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.809654 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.809809 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.809954 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.810098 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.810254 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.810411 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.810555 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.810699 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.810844 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.810999 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.811154 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.811301 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.811301 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.811585 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.811729 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.811886 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.812032 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.812177 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.812332 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.812484 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.812636 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.812789 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.812935 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.813079 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.813222 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.813366 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.813517 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.813853 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.813853 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.814231 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.814377 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.814533 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.814677 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.814831 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.814978 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.815131 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.815275 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.815427 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.815585 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.815731 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.815875 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.816028 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.816180 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.816337 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.816501 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.816668 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.816823 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.816982 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.817139 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.817293 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.817446 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.817615 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.817782 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.817930 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.818077 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.818222 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.818377 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.818522 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.818683 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.818837 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.818982 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.819128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.819273 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.819418 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.819571 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.819718 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.819863 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.820007 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.820154 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.820319 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.820474 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.820619 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.820771 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.820922 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.821072 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.821228 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.821374 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.821519 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.821735 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.821883 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.822038 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.822195 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.822353 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.822498 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.822643 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.822796 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.822942 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.823095 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.823095 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.823375 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.823520 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.823665 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.823888 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.824036 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.824311 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.824466 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.824612 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.824757 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.824911 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.825058 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.825210 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.825356 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.825514 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.825696 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.825814 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.825910 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.825993 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.826089 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.826169 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.826247 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.826335 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.826423 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.826624 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.826733 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.826936 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.827040 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.827244 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.827335 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.827552 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.827640 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.827857 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.827953 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.828202 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.828304 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.828510 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.828603 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.828832 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.828918 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.829150 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.829236 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.830022 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.830171 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.830334 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.830533 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.830687 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.830835 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.830989 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.831136 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.831308 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.831472 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.831653 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.831810 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.831958 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.832103 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.832257 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.832415 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.832561 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.832705 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.832852 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.833002 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.833156 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.833311 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.833466 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.833637 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.833804 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.833958 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.834118 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.834289 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.834533 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.834694 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.834843 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.834997 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.835143 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.835288 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.835440 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.835586 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.835732 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.835890 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.836038 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.836183 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.836328 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.836491 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.836638 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.836792 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.836940 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.837084 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.837229 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.837373 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.837526 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.837742 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.838002 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.838157 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.838303 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.838448 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.838611 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.838758 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.838910 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.839066 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.839211 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.839356 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.839513 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.839659 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.839803 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.839955 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.840102 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.840260 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.840428 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.840574 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.840719 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.840863 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.841007 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.841303 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.841466 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.841632 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.841785 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.841930 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.842074 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.842236 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.842383 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.842545 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.842545 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.842821 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.842965 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.843118 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.843266 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.843411 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.843556 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.843700 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.843844 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.844007 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.844155 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.844301 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.844455 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.844657 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.844808 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.845032 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.845707 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.845854 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.845998 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.846154 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.846378 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.846556 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.846705 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.846859 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.846859 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.847149 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.847308 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.847458 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.847603 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.847755 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.847910 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.848063 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.848219 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.848373 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.848521 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.848667 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.848829 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.848988 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.849134 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.849284 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.849429 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.849594 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.849748 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.849907 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.850062 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.850209 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.850354 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.850507 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.850671 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.850818 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.850962 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.851108 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.851253 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.851510 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.851679 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.851834 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.851980 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.852126 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.852271 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.852416 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.852582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.852731 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.852876 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.852876 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.853151 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.853151 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.853510 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.853715 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.853874 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.854032 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.854178 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.854331 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.854488 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.854726 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.854877 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.855023 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.855168 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.855325 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.855479 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.855635 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.855781 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.855927 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.856084 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.856231 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.856376 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.856535 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.856681 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.856825 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.856980 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.857126 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.857272 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.857416 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.857568 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.857746 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.857913 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.858061 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.858206 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.858363 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.858507 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.858661 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.858807 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.858953 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.859104 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.859104 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.859381 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.859538 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.859684 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.859830 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.859974 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.860127 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.860283 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.860438 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.860664 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.860893 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.861116 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.861272 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.861419 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.861733 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.861889 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.862036 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.862183 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.862328 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.862483 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.862641 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.862788 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.862932 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.863086 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.863234 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.863392 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.863540 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.863684 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.863829 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.863981 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.864130 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.864295 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.864453 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.864598 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.864743 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.864896 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.864896 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.865182 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.865338 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.865483 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.865645 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.865796 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.865954 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.866100 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.866244 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.866400 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.866545 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.866689 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.866842 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.866988 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.867132 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.867132 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.867415 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.867569 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.867723 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.867870 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.868014 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.868165 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.868321 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.868467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.868624 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.868770 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.868914 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.869068 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.869214 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.869371 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.869518 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.869697 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.869844 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.869989 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.870134 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.870302 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.870449 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.870603 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.870750 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.870904 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.871050 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.871204 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.871351 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.871496 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.871660 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.871883 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.872034 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.872200 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.872348 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.872507 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.872661 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.872814 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.872969 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.873116 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.873260 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.873406 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.873551 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.873757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.873916 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.874071 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.874227 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.874371 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.874525 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.874670 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.874824 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.874824 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.875101 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.875247 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.875391 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.875535 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.875688 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.875834 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.875980 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.876166 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.876328 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.876484 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.876632 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.876778 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.876924 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.877075 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.877222 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.877381 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.877528 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.877716 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.877865 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.878018 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.878175 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.878328 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.878488 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.878634 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.878780 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.878925 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.879070 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.879223 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.879369 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.879526 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.879673 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.879819 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.879996 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.880144 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.880289 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.880433 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.880577 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.880723 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.880877 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.881024 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.881170 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.881322 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.881469 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.881650 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.881908 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.882150 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.882302 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.882456 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.882610 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.882770 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.882916 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.883061 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.883208 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.883365 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.883511 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.883665 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.883811 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.883973 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.884132 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.884279 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.884424 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.884581 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.884727 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.884873 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.885017 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.885162 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.885315 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.885462 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.885634 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.885798 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.885945 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.886090 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.886247 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.886402 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.886548 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.886693 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.886838 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.886983 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.887136 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.887295 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.887443 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.887587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.887742 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.887894 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.888048 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.888201 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.888349 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.888494 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.888638 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.888791 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.888937 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.889081 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.889225 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.889370 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.889525 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.889714 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.889863 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.890011 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.890156 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.890300 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.890459 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.890607 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.890763 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.890911 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.891062 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.891209 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.891370 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.891537 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.891684 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.892387 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.892486 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.892653 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.892805 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.892944 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.893124 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.893361 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.893498 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.893717 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.893811 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.893894 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.894065 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.894154 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.894400 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.894544 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.894706 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.894835 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.895016 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.895146 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.895321 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.895463 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.895629 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.895766 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.895934 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.896063 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.896299 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.896441 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.896568 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.896693 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.896818 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.896950 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.897112 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.897242 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.897417 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.897546 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.897781 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.897919 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.898097 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.898227 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.898406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.898535 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.898706 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.898843 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.899012 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.899149 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.899321 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.899450 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.899635 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.899765 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.899944 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.900086 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.900253 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.900382 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.900563 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.900699 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.900874 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.901009 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.901240 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.901377 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.901661 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.901795 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.901990 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.902093 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.902302 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.902416 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.902609 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.902766 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.902917 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.903064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.903227 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.903363 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.903535 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.903673 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.903885 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.904015 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.904230 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.904358 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.904580 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.904709 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.904917 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.905045 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.905243 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.905369 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.905557 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.905699 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.905904 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.906032 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.906275 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.906462 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.906881 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.907028 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.907224 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.907357 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.908092 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.908235 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.908429 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.908557 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.908744 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.908872 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.909169 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.909315 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.909443 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.909566 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.909754 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.909888 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.910014 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.910150 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.910283 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.910410 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.910583 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.910713 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.910895 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.911032 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.911215 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.911350 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.911531 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.911668 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.911882 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.912010 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.912177 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.912305 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.912489 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.912727 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.912867 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.912994 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.913119 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.913236 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.913421 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.913552 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.913765 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.913898 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.914076 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.914251 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.914378 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.914512 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.914692 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.914820 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.915018 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.915148 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.915335 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.915473 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.915601 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:28:00.915730 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.915959 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.916280 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.916615 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.916947 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.917264 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.917807 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.918047 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.918405 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.918726 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.919075 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.919409 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.919728 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.920045 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.920353 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:28:00.920603 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:28:01.072894 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO dbcounter [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Registered counter for database nova_api Sep 01 17:28:01.079020 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO dbcounter [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Registered counter for database nova_api Sep 01 17:28:01.094573 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_db.sqlalchemy.engines [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:28:01.100112 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG oslo_db.sqlalchemy.engines [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105750) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:28:01.102058 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writer thread running {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:28:01.107169 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG dbcounter [-] [105750] Writer thread running {{(pid=105750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:28:01.161637 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.context [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e69bc69-0465-4e2e-a814-7702ef293021(cell1) {{(pid=105749) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 17:28:01.165527 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:28:01.166030 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:28:01.166743 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.context [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e69bc69-0465-4e2e-a814-7702ef293021(cell1) {{(pid=105750) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 17:28:01.167616 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:28:01.168375 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:28:01.168820 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:28:01.170682 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG oslo_concurrency.lockutils [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:28:01.170840 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:28:01.171165 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG oslo_concurrency.lockutils [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:28:01.172741 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG oslo_concurrency.lockutils [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:28:01.172868 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO dbcounter [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Registered counter for database nova_cell0 Sep 01 17:28:01.173698 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG oslo_concurrency.lockutils [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:28:01.174197 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG oslo_concurrency.lockutils [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:28:01.176308 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG oslo_concurrency.lockutils [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:28:01.177137 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO dbcounter [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Registered counter for database nova_cell1 Sep 01 17:28:01.178379 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO dbcounter [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Registered counter for database nova_cell0 Sep 01 17:28:01.182758 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO dbcounter [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Registered counter for database nova_cell1 Sep 01 17:28:01.184524 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_db.sqlalchemy.engines [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:28:01.186822 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_db.sqlalchemy.engines [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:28:01.191568 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG oslo_db.sqlalchemy.engines [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105750) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:28:01.192589 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writer thread running {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:28:01.193011 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG oslo_db.sqlalchemy.engines [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105750) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:28:01.199756 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG dbcounter [-] [105750] Writer thread running {{(pid=105750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:28:01.202038 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG dbcounter [-] [105750] Writer thread running {{(pid=105750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:28:01.335885 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writer thread running {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:28:01.346755 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO dbcounter [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Registered counter for database nova_cell0 Sep 01 17:28:01.355861 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_db.sqlalchemy.engines [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:28:01.361322 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writer thread running {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:28:01.363142 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO dbcounter [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Registered counter for database nova_cell0 Sep 01 17:28:01.370200 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG oslo_db.sqlalchemy.engines [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105750) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:28:01.374986 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG dbcounter [-] [105750] Writer thread running {{(pid=105750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:28:01.709455 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: WARNING keystonemiddleware.auth_token [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:28:01.713246 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: WARNING keystonemiddleware.auth_token [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:28:01.717398 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: WARNING keystonemiddleware.auth_token [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:28:01.721202 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: WARNING keystonemiddleware.auth_token [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:28:02.060590 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: WARNING keystonemiddleware.auth_token [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:28:02.062934 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: WARNING keystonemiddleware.auth_token [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:28:02.067145 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: WARNING keystonemiddleware.auth_token [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:28:02.069497 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: WARNING keystonemiddleware.auth_token [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:28:02.072369 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bc22ee69c0 pid: 105750 (default app) Sep 01 17:28:02.074451 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:28:02.074739 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bc22ee69c0 pid: 105749 (default app) Sep 01 17:28:02.075615 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-50ed7b7e-7cb7-4b7a-80c2-7d4c47386293 None None] 10.222.0.100 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001740 Sep 01 17:28:02.076019 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 1/1] 10.222.0.100 () {50 vars in 793 bytes} [Thu Sep 1 17:28:02 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:22.496012 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:22.497499 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002183 Sep 01 17:29:22.502324 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 1/2] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:29:22 2022] GET /compute/v2.1 => generated 389 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:22.516290 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG dbcounter [-] [105750] Writing DB stats nova_api:SELECT=3 {{(pid=105750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:22.517320 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG dbcounter [-] [105750] Writing DB stats nova_cell0:SELECT=3 {{(pid=105750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:22.518413 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG dbcounter [-] [105750] Writing DB stats nova_cell1:SELECT=3 {{(pid=105750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:22.519512 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG dbcounter [-] [105750] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:23.584610 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-64c5abac-1f40-4420-9824-07ebb03ff072 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:23.620462 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-64c5abac-1f40-4420-9824-07ebb03ff072 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.114947 Sep 01 17:29:23.621772 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 2/3] 10.222.0.100 () {60 vars in 1297 bytes} [Thu Sep 1 17:29:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:29:26.146532 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:26.147178 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-07c6d498-b0c2-4db3-8028-07db8b6707c4 None None] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001520 Sep 01 17:29:26.152940 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 2/4] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:29:26 2022] GET /compute/v2.1 => generated 389 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:26.820516 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-c3eb18ac-e36e-40f6-bf80-757f67b28fc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:26.890422 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-c3eb18ac-e36e-40f6-bf80-757f67b28fc5 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.733129 Sep 01 17:29:26.897676 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 3/5] 10.222.0.100 () {64 vars in 1288 bytes} [Thu Sep 1 17:29:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:29:27.128359 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-305acea3-545c-4b58-b601-2776fc4b07ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:27.135178 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writing DB stats nova_api:SELECT=3 {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:27.136027 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writing DB stats nova_cell1:SELECT=3 {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:27.137028 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writing DB stats nova_cell0:SELECT=3 {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:27.137821 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:27.219296 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-305acea3-545c-4b58-b601-2776fc4b07ee admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.313475 Sep 01 17:29:27.221168 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 3/6] 10.222.0.100 () {64 vars in 1341 bytes} [Thu Sep 1 17:29:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:29:30.040017 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-c3eb18ac-e36e-40f6-bf80-757f67b28fc5 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:30.041230 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-c3eb18ac-e36e-40f6-bf80-757f67b28fc5 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001652 Sep 01 17:29:30.041835 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 4/7] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:29:30 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:30.960937 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-92a23f0c-f6f0-4b59-acbf-ab4768ff2d89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "swap": 0, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:31.009262 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-92a23f0c-f6f0-4b59-acbf-ab4768ff2d89 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.959536 Sep 01 17:29:31.010177 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 4/8] 10.222.0.100 () {64 vars in 1288 bytes} [Thu Sep 1 17:29:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:29:31.023578 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-d74abc4b-d8eb-4af8-88b3-ce3685ae6520 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:31.063795 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-d74abc4b-d8eb-4af8-88b3-ce3685ae6520 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044049 Sep 01 17:29:31.073950 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 5/9] 10.222.0.100 () {64 vars in 1341 bytes} [Thu Sep 1 17:29:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:29:33.730268 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-92a23f0c-f6f0-4b59-acbf-ab4768ff2d89 admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:33.732156 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-92a23f0c-f6f0-4b59-acbf-ab4768ff2d89 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002758 Sep 01 17:29:33.732905 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 5/10] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:29:33 2022] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:34.220691 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-d256a1f1-d38a-472b-be27-08a1d8c9908e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "swap": 0, "ram": 1024, "id": "d2"}} {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:34.241936 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-d256a1f1-d38a-472b-be27-08a1d8c9908e admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.501135 Sep 01 17:29:34.242717 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 6/11] 10.222.0.100 () {64 vars in 1288 bytes} [Thu Sep 1 17:29:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:29:34.255958 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-3efaeb7e-d4f0-4386-b9d1-48da282e311b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:34.285071 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-3efaeb7e-d4f0-4386-b9d1-48da282e311b admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033183 Sep 01 17:29:34.285694 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 6/12] 10.222.0.100 () {64 vars in 1341 bytes} [Thu Sep 1 17:29:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:29:36.784155 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-d256a1f1-d38a-472b-be27-08a1d8c9908e admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:36.785333 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-d256a1f1-d38a-472b-be27-08a1d8c9908e admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001605 Sep 01 17:29:36.785893 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 7/13] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:29:36 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:37.230369 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-1142fb46-a693-4575-bcc9-605ab7d5b927 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:37.252715 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-1142fb46-a693-4575-bcc9-605ab7d5b927 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.460435 Sep 01 17:29:37.253360 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 7/14] 10.222.0.100 () {64 vars in 1288 bytes} [Thu Sep 1 17:29:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:29:37.265758 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-b7764a5e-afb4-4c0d-bbff-9a28f1e693c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:37.292831 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-b7764a5e-afb4-4c0d-bbff-9a28f1e693c1 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030989 Sep 01 17:29:37.293557 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 8/15] 10.222.0.100 () {64 vars in 1341 bytes} [Thu Sep 1 17:29:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:29:39.743067 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-1142fb46-a693-4575-bcc9-605ab7d5b927 admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:39.744086 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-1142fb46-a693-4575-bcc9-605ab7d5b927 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001451 Sep 01 17:29:39.744501 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 8/16] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:29:39 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:29:40.201516 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-811f9ece-f898-4b7c-989a-d80e25d8116f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "name": "ds4G"}} {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:40.223182 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-811f9ece-f898-4b7c-989a-d80e25d8116f admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.471549 Sep 01 17:29:40.223861 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 9/17] 10.222.0.100 () {64 vars in 1288 bytes} [Thu Sep 1 17:29:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:29:40.236141 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-8d11d20b-ee24-435b-8fd2-ef82fba762c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:40.261489 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-8d11d20b-ee24-435b-8fd2-ef82fba762c7 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029203 Sep 01 17:29:40.262140 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 9/18] 10.222.0.100 () {64 vars in 1341 bytes} [Thu Sep 1 17:29:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:29:43.059237 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-811f9ece-f898-4b7c-989a-d80e25d8116f admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:43.060626 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-811f9ece-f898-4b7c-989a-d80e25d8116f admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002382 Sep 01 17:29:43.061282 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 10/19] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:29:43 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:43.483530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-04152866-feaa-4dc9-bb8a-7d9f0971fc1c admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:43.507849 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-04152866-feaa-4dc9-bb8a-7d9f0971fc1c admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.438515 Sep 01 17:29:43.508399 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 10/20] 10.222.0.100 () {60 vars in 1297 bytes} [Thu Sep 1 17:29:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:29:45.976859 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-811f9ece-f898-4b7c-989a-d80e25d8116f admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:45.978371 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-811f9ece-f898-4b7c-989a-d80e25d8116f admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002068 Sep 01 17:29:45.978783 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 11/21] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:29:45 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:46.557199 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-d7460cec-f7b1-4458-a5ca-cb1dd04336ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "name": "m1.tiny", "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:46.579510 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-d7460cec-f7b1-4458-a5ca-cb1dd04336ca admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.590520 Sep 01 17:29:46.580228 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 11/22] 10.222.0.100 () {64 vars in 1288 bytes} [Thu Sep 1 17:29:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:29:46.595277 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-b81fadc8-970b-4b80-9b75-9afe764cd46d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:46.629522 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-b81fadc8-970b-4b80-9b75-9afe764cd46d admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037817 Sep 01 17:29:46.630733 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 12/23] 10.222.0.100 () {64 vars in 1338 bytes} [Thu Sep 1 17:29:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:29:49.273502 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-d7460cec-f7b1-4458-a5ca-cb1dd04336ca admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:49.274629 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-d7460cec-f7b1-4458-a5ca-cb1dd04336ca admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001526 Sep 01 17:29:49.275018 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 12/24] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:29:49 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:49.670939 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-6a8a1e50-02d4-472d-b96f-730f6bc16017 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:49.689288 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-6a8a1e50-02d4-472d-b96f-730f6bc16017 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.407260 Sep 01 17:29:49.689873 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 13/25] 10.222.0.100 () {64 vars in 1288 bytes} [Thu Sep 1 17:29:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:29:49.702414 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-465a791b-ed6b-4676-ab95-870ab29584e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:49.733796 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-465a791b-ed6b-4676-ab95-870ab29584e6 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035427 Sep 01 17:29:49.734405 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 13/26] 10.222.0.100 () {64 vars in 1338 bytes} [Thu Sep 1 17:29:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:29:52.134606 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-6a8a1e50-02d4-472d-b96f-730f6bc16017 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:52.135537 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-6a8a1e50-02d4-472d-b96f-730f6bc16017 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001466 Sep 01 17:29:52.135941 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 14/27] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:29:52 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:52.635287 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-800b7cca-b295-420c-8605-905d82acf220 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "disk": 40, "name": "m1.medium", "swap": 0}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:52.720201 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-800b7cca-b295-420c-8605-905d82acf220 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.577394 Sep 01 17:29:52.720948 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 14/28] 10.222.0.100 () {64 vars in 1288 bytes} [Thu Sep 1 17:29:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:29:52.733760 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-165a0e5f-9af4-4326-9551-1d9a85eebb81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:52.738762 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG dbcounter [-] [105750] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:52.762009 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-165a0e5f-9af4-4326-9551-1d9a85eebb81 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032711 Sep 01 17:29:52.762798 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 15/29] 10.222.0.100 () {64 vars in 1338 bytes} [Thu Sep 1 17:29:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:29:55.164736 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-800b7cca-b295-420c-8605-905d82acf220 admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:55.165818 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-800b7cca-b295-420c-8605-905d82acf220 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001512 Sep 01 17:29:55.166238 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 15/30] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:29:55 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:29:55.622238 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-1de656b5-120d-4567-8550-109137736f92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:55.642867 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-1de656b5-120d-4567-8550-109137736f92 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.469015 Sep 01 17:29:55.643477 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 16/31] 10.222.0.100 () {64 vars in 1288 bytes} [Thu Sep 1 17:29:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:29:55.656057 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-5356c47c-00d1-4120-abdf-f630fb16809e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:55.682859 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-5356c47c-00d1-4120-abdf-f630fb16809e admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031118 Sep 01 17:29:55.683449 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 16/32] 10.222.0.100 () {64 vars in 1338 bytes} [Thu Sep 1 17:29:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:29:58.215619 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-1de656b5-120d-4567-8550-109137736f92 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:58.216556 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-1de656b5-120d-4567-8550-109137736f92 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001464 Sep 01 17:29:58.217284 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 17/33] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:29:58 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:58.670821 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-03562746-5815-4c0a-bdb4-f65d8f3ae4b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "name": "m1.xlarge", "disk": 160, "ram": 16384}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:58.682240 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:58.693975 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-03562746-5815-4c0a-bdb4-f65d8f3ae4b4 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.470066 Sep 01 17:29:58.694699 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 17/34] 10.222.0.100 () {64 vars in 1288 bytes} [Thu Sep 1 17:29:58 2022] POST /compute/v2.1/flavors => generated 410 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:29:58.707008 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-c158cd65-a04c-4630-abb2-79f77c92a2d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:29:58.732378 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-c158cd65-a04c-4630-abb2-79f77c92a2d1 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028842 Sep 01 17:29:58.733701 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 18/35] 10.222.0.100 () {64 vars in 1338 bytes} [Thu Sep 1 17:29:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:30:16.670231 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-03562746-5815-4c0a-bdb4-f65d8f3ae4b4 admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:16.671259 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-03562746-5815-4c0a-bdb4-f65d8f3ae4b4 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002015 Sep 01 17:30:16.671666 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 18/36] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:30:16 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:30:16.682808 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG dbcounter [-] [105750] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:30:17.067099 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-a80b60f7-8b17-429b-b7e6-6457779abbcf admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:17.089054 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-a80b60f7-8b17-429b-b7e6-6457779abbcf admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.410644 Sep 01 17:30:17.089690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 19/37] 10.222.0.100 () {60 vars in 1297 bytes} [Thu Sep 1 17:30:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:30:18.184837 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-03562746-5815-4c0a-bdb4-f65d8f3ae4b4 admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:18.186111 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-03562746-5815-4c0a-bdb4-f65d8f3ae4b4 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001493 Sep 01 17:30:18.186280 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 19/38] 10.222.0.100 () {56 vars in 1079 bytes} [Thu Sep 1 17:30:18 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:30:18.735611 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-1530ccb7-19e4-4a0c-ae94-a932cbf35123 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:18.741358 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.wsgi [None req-1530ccb7-19e4-4a0c-ae94-a932cbf35123 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-1530ccb7-19e4-4a0c-ae94-a932cbf35123 admin admin] Request method failure captured: Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Accept: application/json Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Accept-Encoding: gzip, deflate Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Connection: keep-alive Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Content-Length: 0 Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Host: 10.222.0.100 Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Openstack-Api-Version: compute 2.90 Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Openstack-System-Scope: None Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: User-Agent: python-novaclient Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Auth-Token: gAAAAABjEOwqMVbufHd0N6gNG34MKcdXB_JesAeaVGkft4Agq0--ZKio1jpdXulmSmoSPoOTERVeP9WO-BRxLLtnL_BWwwU0GBrH4qoK7p60Ve0If-u4VciS4As9JiXm9hH4X1sAtmTOwPE78bAC--4LSezYujH9Wbo0iN5elRMh3AuligV4dcU Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Domain-Id: None Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Domain-Name: None Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Identity-Status: Confirmed Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Is-Admin-Project: True Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Project-Domain-Id: default Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Project-Domain-Name: Default Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Project-Id: 392e00333a6b41639a27c8ea706c3db5 Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Project-Name: admin Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Role: reader,admin,member Sep 01 17:30:18.744674 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Roles: reader,admin,member Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Tenant: admin Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Tenant-Id: 392e00333a6b41639a27c8ea706c3db5 Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Tenant-Name: admin Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User: admin Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User-Domain-Id: default Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User-Domain-Name: Default Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User-Id: d51a342066d64ae3b06abd4744cb8e8b Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User-Name: admin Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: method: > Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: exception: Flavor 42 could not be found. Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: action_args: {'id': '42'} Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:30:18.746406 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:30:18.749285 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:18.750690 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-1530ccb7-19e4-4a0c-ae94-a932cbf35123 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:30:18.752175 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-1530ccb7-19e4-4a0c-ae94-a932cbf35123 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.417448 Sep 01 17:30:18.752175 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 20/39] 10.222.0.100 () {60 vars in 1195 bytes} [Thu Sep 1 17:30:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:30:18.756872 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-6eb1e42b-2ce3-4904-a1dc-15103366dca7 admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:18.780990 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-6eb1e42b-2ce3-4904-a1dc-15103366dca7 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027732 Sep 01 17:30:18.781568 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 20/40] 10.222.0.100 () {60 vars in 1215 bytes} [Thu Sep 1 17:30:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:30:18.792164 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-6c523a91-ffed-4bd7-82fc-127bf3e9fd42 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:18.817721 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-6c523a91-ffed-4bd7-82fc-127bf3e9fd42 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.029414 Sep 01 17:30:18.818290 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 21/41] 10.222.0.100 () {60 vars in 1215 bytes} [Thu Sep 1 17:30:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:30:18.828695 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-9d6065db-3f58-4dd5-b755-3e85a156d4a7 admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:18.835284 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.wsgi [None req-9d6065db-3f58-4dd5-b755-3e85a156d4a7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-9d6065db-3f58-4dd5-b755-3e85a156d4a7 admin admin] Request method failure captured: Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Accept: application/json Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Accept-Encoding: gzip, deflate Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Connection: keep-alive Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Content-Length: 0 Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Host: 10.222.0.100 Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Openstack-Api-Version: compute 2.90 Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Openstack-System-Scope: None Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: User-Agent: python-novaclient Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Auth-Token: gAAAAABjEOwqMVbufHd0N6gNG34MKcdXB_JesAeaVGkft4Agq0--ZKio1jpdXulmSmoSPoOTERVeP9WO-BRxLLtnL_BWwwU0GBrH4qoK7p60Ve0If-u4VciS4As9JiXm9hH4X1sAtmTOwPE78bAC--4LSezYujH9Wbo0iN5elRMh3AuligV4dcU Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Domain-Id: None Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Domain-Name: None Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Identity-Status: Confirmed Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Is-Admin-Project: True Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Project-Domain-Id: default Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Project-Domain-Name: Default Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Project-Id: 392e00333a6b41639a27c8ea706c3db5 Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Project-Name: admin Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Role: reader,admin,member Sep 01 17:30:18.838587 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Roles: reader,admin,member Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Tenant: admin Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Tenant-Id: 392e00333a6b41639a27c8ea706c3db5 Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Tenant-Name: admin Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User: admin Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User-Domain-Id: default Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User-Domain-Name: Default Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User-Id: d51a342066d64ae3b06abd4744cb8e8b Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User-Name: admin Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: method: > Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: exception: Flavor 42 could not be found. Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: action_args: {'id': '42'} Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:30:18.840757 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:30:18.841784 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:18.843128 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-9d6065db-3f58-4dd5-b755-3e85a156d4a7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:30:18.844341 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-9d6065db-3f58-4dd5-b755-3e85a156d4a7 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015724 Sep 01 17:30:18.844341 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 21/42] 10.222.0.100 () {60 vars in 1195 bytes} [Thu Sep 1 17:30:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:30:19.859854 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-6c523a91-ffed-4bd7-82fc-127bf3e9fd42 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:19.860863 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-6c523a91-ffed-4bd7-82fc-127bf3e9fd42 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001490 Sep 01 17:30:19.861266 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 22/43] 10.222.0.100 () {56 vars in 1079 bytes} [Thu Sep 1 17:30:19 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:30:20.418770 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-e1cb8d6f-adde-45a6-b7fe-70dc65648251 admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:20.424534 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.wsgi [None req-e1cb8d6f-adde-45a6-b7fe-70dc65648251 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-e1cb8d6f-adde-45a6-b7fe-70dc65648251 admin admin] Request method failure captured: Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Accept: application/json Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Accept-Encoding: gzip, deflate Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Connection: keep-alive Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Content-Length: 0 Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Host: 10.222.0.100 Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Openstack-Api-Version: compute 2.90 Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Openstack-System-Scope: None Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: User-Agent: python-novaclient Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Auth-Token: gAAAAABjEOwrb03IpIVYQYdp0MlP8ZwLHGncQvg0MM01A9tEWSEsd5gSwVEKT8Skmta8hdY5SeIPn9vMf3mfNnMQs38rmUwICZ4dCO9vmbtfI-mI8ODr5kLoHhksvD3QGRDlCNDCSNXtBmu7dN3-I9os8Qe5uviMkvslph4jHkEkRYoRcVWeF7o Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Domain-Id: None Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Domain-Name: None Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Identity-Status: Confirmed Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Is-Admin-Project: True Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Project-Domain-Id: default Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Project-Domain-Name: Default Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Project-Id: 392e00333a6b41639a27c8ea706c3db5 Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Project-Name: admin Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Role: reader,admin,member Sep 01 17:30:20.426064 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Roles: reader,admin,member Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Tenant: admin Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Tenant-Id: 392e00333a6b41639a27c8ea706c3db5 Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Tenant-Name: admin Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User: admin Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User-Domain-Id: default Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User-Domain-Name: Default Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User-Id: d51a342066d64ae3b06abd4744cb8e8b Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User-Name: admin Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: method: > Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: exception: Flavor 84 could not be found. Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: action_args: {'id': '84'} Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:30:20.427582 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:30:20.428467 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:20.429530 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-e1cb8d6f-adde-45a6-b7fe-70dc65648251 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:30:20.430597 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-e1cb8d6f-adde-45a6-b7fe-70dc65648251 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.419599 Sep 01 17:30:20.430597 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 22/44] 10.222.0.100 () {60 vars in 1195 bytes} [Thu Sep 1 17:30:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:30:20.438202 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-b4799b60-34e3-4838-a6a1-1499d7adbfb4 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:20.454024 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-b4799b60-34e3-4838-a6a1-1499d7adbfb4 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.020379 Sep 01 17:30:20.454574 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 23/45] 10.222.0.100 () {60 vars in 1215 bytes} [Thu Sep 1 17:30:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:30:20.464018 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-a4d36623-d6ba-4c71-b62f-a36a9741465e admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:20.480120 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-a4d36623-d6ba-4c71-b62f-a36a9741465e admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019511 Sep 01 17:30:20.480669 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 23/46] 10.222.0.100 () {60 vars in 1215 bytes} [Thu Sep 1 17:30:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:30:20.490395 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-92af7d63-024a-4781-95ad-30a8eaef0f13 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:20.495776 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.wsgi [None req-92af7d63-024a-4781-95ad-30a8eaef0f13 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-92af7d63-024a-4781-95ad-30a8eaef0f13 admin admin] Request method failure captured: Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Accept: application/json Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Accept-Encoding: gzip, deflate Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Connection: keep-alive Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Content-Length: 0 Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Host: 10.222.0.100 Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Openstack-Api-Version: compute 2.90 Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Openstack-System-Scope: None Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: User-Agent: python-novaclient Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Auth-Token: gAAAAABjEOwrb03IpIVYQYdp0MlP8ZwLHGncQvg0MM01A9tEWSEsd5gSwVEKT8Skmta8hdY5SeIPn9vMf3mfNnMQs38rmUwICZ4dCO9vmbtfI-mI8ODr5kLoHhksvD3QGRDlCNDCSNXtBmu7dN3-I9os8Qe5uviMkvslph4jHkEkRYoRcVWeF7o Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Domain-Id: None Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Domain-Name: None Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Identity-Status: Confirmed Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Is-Admin-Project: True Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Project-Domain-Id: default Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Project-Domain-Name: Default Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Project-Id: 392e00333a6b41639a27c8ea706c3db5 Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Project-Name: admin Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Role: reader,admin,member Sep 01 17:30:20.497857 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Roles: reader,admin,member Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Tenant: admin Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Tenant-Id: 392e00333a6b41639a27c8ea706c3db5 Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Tenant-Name: admin Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User: admin Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User-Domain-Id: default Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User-Domain-Name: Default Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User-Id: d51a342066d64ae3b06abd4744cb8e8b Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User-Name: admin Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: method: > Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: exception: Flavor 84 could not be found. Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: action_args: {'id': '84'} Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:30:20.499438 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:30:20.500346 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:20.501481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-92af7d63-024a-4781-95ad-30a8eaef0f13 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:30:20.502617 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-92af7d63-024a-4781-95ad-30a8eaef0f13 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012459 Sep 01 17:30:20.502617 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 24/47] 10.222.0.100 () {60 vars in 1195 bytes} [Thu Sep 1 17:30:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:30:21.567141 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-a4d36623-d6ba-4c71-b62f-a36a9741465e admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:21.568163 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-a4d36623-d6ba-4c71-b62f-a36a9741465e admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001470 Sep 01 17:30:21.568566 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 24/48] 10.222.0.100 () {56 vars in 1079 bytes} [Thu Sep 1 17:30:21 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:30:22.105114 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-020b47c9-0475-4187-b5c6-378cb7a22ec9 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:22.110962 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.wsgi [None req-020b47c9-0475-4187-b5c6-378cb7a22ec9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-020b47c9-0475-4187-b5c6-378cb7a22ec9 admin admin] Request method failure captured: Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Accept: application/json Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Accept-Encoding: gzip, deflate Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Connection: keep-alive Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Content-Length: 0 Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Host: 10.222.0.100 Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Openstack-Api-Version: compute 2.90 Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Openstack-System-Scope: None Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: User-Agent: python-novaclient Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Auth-Token: gAAAAABjEOwt6fzBVbAmyre-W49bhuZciIWOldGvpbtgtR1H1tugc-9BuIUj9tmx1iq8WS52d2gth2_Gdob-5ZyCPpUilJUtJuJoY9aULjJzfXErHihwS-eCg8l17fIspQ3FG3JnDrrN9eqmEVwCE4vzHDPZwab-dsVtsbTl6Tfs-09ljOgU2es Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Domain-Id: None Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Domain-Name: None Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Identity-Status: Confirmed Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Is-Admin-Project: True Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Project-Domain-Id: default Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Project-Domain-Name: Default Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Project-Id: 392e00333a6b41639a27c8ea706c3db5 Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Project-Name: admin Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Role: reader,admin,member Sep 01 17:30:22.112467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Roles: reader,admin,member Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Tenant: admin Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Tenant-Id: 392e00333a6b41639a27c8ea706c3db5 Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-Tenant-Name: admin Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User: admin Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User-Domain-Id: default Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User-Domain-Name: Default Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User-Id: d51a342066d64ae3b06abd4744cb8e8b Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: X-User-Name: admin Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: method: > Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: exception: Flavor 451 could not be found. Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: action_args: {'id': '451'} Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:30:22.114067 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:30:22.115098 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: ERROR nova.api.openstack.wsgi Sep 01 17:30:22.116633 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-020b47c9-0475-4187-b5c6-378cb7a22ec9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:30:22.117899 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-020b47c9-0475-4187-b5c6-378cb7a22ec9 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.403135 Sep 01 17:30:22.117899 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 25/49] 10.222.0.100 () {60 vars in 1198 bytes} [Thu Sep 1 17:30:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:30:22.124100 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-d788a43b-d1ff-4234-96f0-c333ba7b814f admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:22.139577 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-d788a43b-d1ff-4234-96f0-c333ba7b814f admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019537 Sep 01 17:30:22.140137 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 25/50] 10.222.0.100 () {60 vars in 1215 bytes} [Thu Sep 1 17:30:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:30:22.149900 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:22.165423 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019055 Sep 01 17:30:22.166003 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 26/51] 10.222.0.100 () {60 vars in 1215 bytes} [Thu Sep 1 17:30:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:30:22.176004 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-ee2c34f1-8c13-4636-9269-77cd60507bf5 admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:22.181685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.wsgi [None req-ee2c34f1-8c13-4636-9269-77cd60507bf5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-ee2c34f1-8c13-4636-9269-77cd60507bf5 admin admin] Request method failure captured: Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Accept: application/json Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Accept-Encoding: gzip, deflate Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Connection: keep-alive Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Content-Length: 0 Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Host: 10.222.0.100 Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Openstack-Api-Version: compute 2.90 Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Openstack-System-Scope: None Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: User-Agent: python-novaclient Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Auth-Token: gAAAAABjEOwt6fzBVbAmyre-W49bhuZciIWOldGvpbtgtR1H1tugc-9BuIUj9tmx1iq8WS52d2gth2_Gdob-5ZyCPpUilJUtJuJoY9aULjJzfXErHihwS-eCg8l17fIspQ3FG3JnDrrN9eqmEVwCE4vzHDPZwab-dsVtsbTl6Tfs-09ljOgU2es Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Domain-Id: None Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Domain-Name: None Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Identity-Status: Confirmed Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Is-Admin-Project: True Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Project-Domain-Id: default Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Project-Domain-Name: Default Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Project-Id: 392e00333a6b41639a27c8ea706c3db5 Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Project-Name: admin Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Role: reader,admin,member Sep 01 17:30:22.183197 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Roles: reader,admin,member Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/392e00333a6b41639a27c8ea706c3db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Tenant: admin Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Tenant-Id: 392e00333a6b41639a27c8ea706c3db5 Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-Tenant-Name: admin Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User: admin Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User-Domain-Id: default Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User-Domain-Name: Default Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User-Id: d51a342066d64ae3b06abd4744cb8e8b Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: X-User-Name: admin Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: method: > Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: exception: Flavor 451 could not be found. Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: action_args: {'id': '451'} Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:30:22.185401 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:30:22.186626 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: ERROR nova.api.openstack.wsgi Sep 01 17:30:22.187685 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-ee2c34f1-8c13-4636-9269-77cd60507bf5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:30:22.188742 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-ee2c34f1-8c13-4636-9269-77cd60507bf5 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012149 Sep 01 17:30:22.188742 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 26/52] 10.222.0.100 () {60 vars in 1198 bytes} [Thu Sep 1 17:30:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:30:23.202398 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:23.203481 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001619 Sep 01 17:30:23.203872 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 27/53] 10.222.0.100 () {56 vars in 1079 bytes} [Thu Sep 1 17:30:23 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:30:23.806955 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-e72cca46-bebc-4f5e-bedf-d7c1792560f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:30:23.830365 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-e72cca46-bebc-4f5e-bedf-d7c1792560f9 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.478294 Sep 01 17:30:23.830967 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 27/54] 10.222.0.100 () {64 vars in 1240 bytes} [Thu Sep 1 17:30:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:30:24.890412 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:24.891455 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001475 Sep 01 17:30:24.891939 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 28/55] 10.222.0.100 () {56 vars in 1079 bytes} [Thu Sep 1 17:30:24 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:30:25.500046 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-ec8148a4-cc8d-4c18-b588-399bd75a9d65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:30:25.521182 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-ec8148a4-cc8d-4c18-b588-399bd75a9d65 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.484221 Sep 01 17:30:25.521826 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 28/56] 10.222.0.100 () {64 vars in 1240 bytes} [Thu Sep 1 17:30:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:30:26.615924 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:26.616949 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001538 Sep 01 17:30:26.617355 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 29/57] 10.222.0.100 () {56 vars in 1079 bytes} [Thu Sep 1 17:30:26 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:30:27.192258 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-6424282c-6aca-4daa-8d76-86a3ed168bb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:30:27.217614 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-6424282c-6aca-4daa-8d76-86a3ed168bb5 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.458233 Sep 01 17:30:27.218161 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 29/58] 10.222.0.100 () {64 vars in 1240 bytes} [Thu Sep 1 17:30:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:30:28.266400 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:28.267409 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001493 Sep 01 17:30:28.267810 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 30/59] 10.222.0.100 () {56 vars in 1079 bytes} [Thu Sep 1 17:30:28 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:30:28.936227 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-573662c6-ff23-4fa8-b078-dd28dcd46817 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:30:28.964136 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-573662c6-ff23-4fa8-b078-dd28dcd46817 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.552096 Sep 01 17:30:28.964699 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 30/60] 10.222.0.100 () {64 vars in 1240 bytes} [Thu Sep 1 17:30:28 2022] POST /compute/v2.1/flavors => generated 411 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:30:30.087028 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:30.088052 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001480 Sep 01 17:30:30.088467 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 31/61] 10.222.0.100 () {56 vars in 1079 bytes} [Thu Sep 1 17:30:30 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:30:30.738971 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-ff2e0369-2cfa-47f6-a720-49d98da0f43c admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:30:30.761079 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-ff2e0369-2cfa-47f6-a720-49d98da0f43c admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.530343 Sep 01 17:30:30.761906 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 31/62] 10.222.0.100 () {60 vars in 1207 bytes} [Thu Sep 1 17:30:30 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:26.869111 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:26.870082 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-99381862-8f97-4fea-91d9-f9b482ed7643 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001539 Sep 01 17:31:26.870652 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 32/63] 10.222.0.100 () {54 vars in 936 bytes} [Thu Sep 1 17:31:26 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:26.880945 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:27.391423 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-7a32e6d0-df37-47aa-af96-90e32d69827d admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:27.411944 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-7a32e6d0-df37-47aa-af96-90e32d69827d admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.535437 Sep 01 17:31:27.412494 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 32/64] 10.222.0.100 () {60 vars in 1297 bytes} [Thu Sep 1 17:31:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:31:27.434181 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG dbcounter [-] [105750] Writing DB stats nova_api:SELECT=14 {{(pid=105750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:27.437989 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-ad763d9d-7783-4774-9ccd-41117e7bb45d admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:27.446741 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-ad763d9d-7783-4774-9ccd-41117e7bb45d admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014323 Sep 01 17:31:27.446939 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 33/65] 10.222.0.100 () {60 vars in 1288 bytes} [Thu Sep 1 17:31:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:27.459846 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-1608e5b8-3267-41e2-9d71-cdfe85be7adc admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:27.467674 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-1608e5b8-3267-41e2-9d71-cdfe85be7adc admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011721 Sep 01 17:31:27.468206 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 33/66] 10.222.0.100 () {60 vars in 1291 bytes} [Thu Sep 1 17:31:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:27.480620 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-7b95aa2a-e893-49c6-b966-f8092c1e979c admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:27.488760 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-7b95aa2a-e893-49c6-b966-f8092c1e979c admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011965 Sep 01 17:31:27.489232 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 34/67] 10.222.0.100 () {60 vars in 1291 bytes} [Thu Sep 1 17:31:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:27.501815 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-2260bb15-f290-4292-a02f-388d47f16140 admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:27.509516 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-2260bb15-f290-4292-a02f-388d47f16140 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011306 Sep 01 17:31:27.510084 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 34/68] 10.222.0.100 () {60 vars in 1288 bytes} [Thu Sep 1 17:31:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:30.639235 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-7b95aa2a-e893-49c6-b966-f8092c1e979c admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:30.640354 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-7b95aa2a-e893-49c6-b966-f8092c1e979c admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001551 Sep 01 17:34:30.640824 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 35/69] 10.222.0.100 () {56 vars in 1079 bytes} [Thu Sep 1 17:34:30 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:34:30.786336 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writing DB stats nova_api:SELECT=6 {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:30.948105 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-b6a9ee16-5112-4c7f-95b7-869f4f2dd3c7 admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:30.951465 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-b6a9ee16-5112-4c7f-95b7-869f4f2dd3c7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:30.951941 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-b6a9ee16-5112-4c7f-95b7-869f4f2dd3c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:30.952371 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-b6a9ee16-5112-4c7f-95b7-869f4f2dd3c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:30.953081 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-b6a9ee16-5112-4c7f-95b7-869f4f2dd3c7 admin admin] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:30.953531 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-b6a9ee16-5112-4c7f-95b7-869f4f2dd3c7 admin admin] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:30.953975 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-b6a9ee16-5112-4c7f-95b7-869f4f2dd3c7 admin admin] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:30.987657 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-b6a9ee16-5112-4c7f-95b7-869f4f2dd3c7 admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.203041 Sep 01 17:34:30.988219 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 35/70] 10.222.0.100 () {60 vars in 1198 bytes} [Thu Sep 1 17:34:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:34:31.815420 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-7b95aa2a-e893-49c6-b966-f8092c1e979c admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:31.816434 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-7b95aa2a-e893-49c6-b966-f8092c1e979c admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001428 Sep 01 17:34:31.816827 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 36/71] 10.222.0.100 () {56 vars in 1079 bytes} [Thu Sep 1 17:34:31 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:34:32.010686 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-0b4b91e3-e217-4ecb-be98-b7b204ad6c1b admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:32.014300 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-0b4b91e3-e217-4ecb-be98-b7b204ad6c1b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:32.014802 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-0b4b91e3-e217-4ecb-be98-b7b204ad6c1b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:32.015251 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-0b4b91e3-e217-4ecb-be98-b7b204ad6c1b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:32.015989 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-0b4b91e3-e217-4ecb-be98-b7b204ad6c1b admin admin] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:32.016438 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-0b4b91e3-e217-4ecb-be98-b7b204ad6c1b admin admin] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:32.016908 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-0b4b91e3-e217-4ecb-be98-b7b204ad6c1b admin admin] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:32.038731 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-0b4b91e3-e217-4ecb-be98-b7b204ad6c1b admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081056 Sep 01 17:34:32.039316 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 36/72] 10.222.0.100 () {60 vars in 1198 bytes} [Thu Sep 1 17:34:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:34:43.295383 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-7b95aa2a-e893-49c6-b966-f8092c1e979c admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:43.296384 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-7b95aa2a-e893-49c6-b966-f8092c1e979c admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001454 Sep 01 17:34:43.296775 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 37/73] 10.222.0.100 () {56 vars in 1079 bytes} [Thu Sep 1 17:34:43 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:34:43.439036 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writing DB stats nova_cell0:SELECT=4 {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:43.439766 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writing DB stats nova_cell1:SELECT=4 {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:43.440392 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG dbcounter [-] [105749] Writing DB stats nova_api:SELECT=8 {{(pid=105749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:43.488905 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-36cd39dc-3b1b-4b4a-93cf-69a527e1a807 admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:43.492309 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-36cd39dc-3b1b-4b4a-93cf-69a527e1a807 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:43.492796 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-36cd39dc-3b1b-4b4a-93cf-69a527e1a807 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:43.493207 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-36cd39dc-3b1b-4b4a-93cf-69a527e1a807 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:43.493941 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-36cd39dc-3b1b-4b4a-93cf-69a527e1a807 admin admin] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:43.494383 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-36cd39dc-3b1b-4b4a-93cf-69a527e1a807 admin admin] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:43.494884 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-36cd39dc-3b1b-4b4a-93cf-69a527e1a807 admin admin] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:43.519902 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-36cd39dc-3b1b-4b4a-93cf-69a527e1a807 admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085251 Sep 01 17:34:43.520383 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 37/74] 10.222.0.100 () {60 vars in 1198 bytes} [Thu Sep 1 17:34:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:34:44.348445 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: DEBUG nova.api.openstack.wsgi [None req-7b95aa2a-e893-49c6-b966-f8092c1e979c admin admin] Calling method '>' {{(pid=105750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:44.349441 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: INFO nova.api.openstack.requestlog [None req-7b95aa2a-e893-49c6-b966-f8092c1e979c admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001444 Sep 01 17:34:44.349871 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: [pid: 105750|app: 0|req: 38/75] 10.222.0.100 () {56 vars in 1079 bytes} [Thu Sep 1 17:34:44 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:34:44.543448 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG nova.api.openstack.wsgi [None req-5119ccf3-b530-48d0-aef9-9b93b34906c6 admin admin] Calling method '>' {{(pid=105749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:44.546905 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-5119ccf3-b530-48d0-aef9-9b93b34906c6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:44.547379 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-5119ccf3-b530-48d0-aef9-9b93b34906c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:44.547807 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-5119ccf3-b530-48d0-aef9-9b93b34906c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:44.548521 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-5119ccf3-b530-48d0-aef9-9b93b34906c6 admin admin] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:44.548960 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-5119ccf3-b530-48d0-aef9-9b93b34906c6 admin admin] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:44.549374 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: DEBUG oslo_concurrency.lockutils [None req-5119ccf3-b530-48d0-aef9-9b93b34906c6 admin admin] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:44.571611 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: INFO nova.api.openstack.requestlog [None req-5119ccf3-b530-48d0-aef9-9b93b34906c6 admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081474 Sep 01 17:34:44.572080 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: [pid: 105749|app: 0|req: 38/76] 10.222.0.100 () {60 vars in 1198 bytes} [Thu Sep 1 17:34:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:43.248403 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: Thu Sep 1 17:35:43 2022 - graceful shutdown triggered... Sep 01 17:35:43.248531 dv-cinder-839768-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 17:35:43.249614 dv-cinder-839768-6-iscsi devstack@n-api.service[105749]: Gracefully killing worker 1 (pid: 105749)... Sep 01 17:35:43.250011 dv-cinder-839768-6-iscsi devstack@n-api.service[105750]: Gracefully killing worker 2 (pid: 105750)... Sep 01 17:35:44.250725 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: worker 1 buried after 1 seconds Sep 01 17:35:44.251293 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: worker 2 buried after 1 seconds Sep 01 17:35:44.251293 dv-cinder-839768-6-iscsi devstack@n-api.service[105740]: goodbye to uWSGI. Sep 01 17:35:44.252326 dv-cinder-839768-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 17:35:44.252887 dv-cinder-839768-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 17:35:44.255839 dv-cinder-839768-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 17:35:44.266264 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 17:35:44.268890 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 17:35:44 2022] *** Sep 01 17:35:44.269052 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 17:35:44.269052 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 17:35:44.269052 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: nodename: dv-cinder-839768-6-iscsi Sep 01 17:35:44.269052 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: machine: x86_64 Sep 01 17:35:44.269052 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: clock source: unix Sep 01 17:35:44.269052 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: pcre jit disabled Sep 01 17:35:44.269052 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: detected number of CPU cores: 4 Sep 01 17:35:44.269052 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: current working directory: / Sep 01 17:35:44.269052 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: detected binary path: /usr/bin/uwsgi-core Sep 01 17:35:44.269052 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: your processes number limit is 47680 Sep 01 17:35:44.269774 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: your memory page size is 4096 bytes Sep 01 17:35:44.269774 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: detected max file descriptor number: 2048 Sep 01 17:35:44.269774 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: lock engine: pthread robust mutexes Sep 01 17:35:44.269774 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: thunder lock: enabled Sep 01 17:35:44.269774 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 17:35:44.269774 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 17:35:44.310197 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: Python main interpreter initialized at 0x55ecc96199c0 Sep 01 17:35:44.310197 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: python threads support enabled Sep 01 17:35:44.310197 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: your server socket listen backlog is limited to 100 connections Sep 01 17:35:44.310197 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: your mercy for graceful operations on workers is 90 seconds Sep 01 17:35:44.310635 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 17:35:44.310635 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: *** Operational MODE: preforking *** Sep 01 17:35:44.310904 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: *** uWSGI is running in multiple interpreter mode *** Sep 01 17:35:44.310904 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: spawned uWSGI master process (pid: 127221) Sep 01 17:35:44.311113 dv-cinder-839768-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 17:35:44.311965 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: spawned uWSGI worker 1 (pid: 127232, cores: 1) Sep 01 17:35:44.312088 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: spawned uWSGI worker 2 (pid: 127233, cores: 1) Sep 01 17:35:44.312251 dv-cinder-839768-6-iscsi devstack@n-api.service[127221]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 17:35:44.996991 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 17:35:44.998653 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 17:35:46.169629 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:35:46.169629 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: from cryptography.utils import int_from_bytes Sep 01 17:35:46.170283 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:35:46.170283 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: from cryptography.utils import int_from_bytes Sep 01 17:35:46.174822 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:35:46.174822 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: from cryptography.utils import int_from_bytes Sep 01 17:35:46.175271 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:35:46.175271 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: from cryptography.utils import int_from_bytes Sep 01 17:35:48.641765 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:35:48.642353 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:35:48.642441 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:35:48.642441 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:35:48.642871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:35:48.643243 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:35:48.643351 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:35:48.643437 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:35:48.643517 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:35:48.643605 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:35:48.643676 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.643868 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.643969 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.644198 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.644611 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.644703 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.644782 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.644852 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.644921 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.645175 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.645286 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.645491 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.645657 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.645844 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.645988 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.646169 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.646414 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.646512 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.646598 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.646765 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.646926 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.647068 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.647177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-6-iscsi {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.647397 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-6-iscsi {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.647669 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.647883 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.648020 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.648197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.648310 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.648509 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.648619 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.648834 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.648949 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.649143 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.649251 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.649471 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.649608 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.649809 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.650039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.650470 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.650583 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.650697 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.650792 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.651006 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.651139 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.651328 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.651477 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.651663 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.652445 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.652578 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.652696 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.652932 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.653068 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.653257 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.653391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.653615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.653758 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.653921 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.654049 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.654253 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.654386 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-6-iscsi {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.654660 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.654835 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-6-iscsi {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.654979 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.655105 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.655279 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.655405 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.655600 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.655730 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.656016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.656221 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.656354 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.656491 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.656619 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.656755 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.656937 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.657076 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.657275 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.657422 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.657600 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.657749 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.658157 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.658320 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.658320 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.658538 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.658677 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.658817 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.658934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.659057 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.659198 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.659318 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.659806 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.659937 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.660057 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.660179 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.660289 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.660405 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.660405 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.660888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.661011 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.661127 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.661237 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.661352 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.661484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.661649 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.661822 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.661962 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.662414 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.662567 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.662694 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.662833 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.662954 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.663080 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.663080 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.663344 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.663554 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.663798 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.663922 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.664046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.664174 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.664300 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.664446 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.664575 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.664846 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.664984 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.665117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.665252 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.665390 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.665533 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.665744 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.665883 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.666017 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.666145 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.666282 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.666411 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.666539 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.666673 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.666810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.666948 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.667076 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.667202 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.667376 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.667516 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.667908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.668391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.668505 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.669122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.669248 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.670025 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.670195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.670336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.670474 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.670603 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.670603 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.670844 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.670985 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.671210 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.671340 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.671628 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.671778 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.671916 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.672153 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.672288 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.672480 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.672655 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.672828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.673095 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.673233 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.673385 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.673930 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.674058 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.674151 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.674245 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.674336 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.674427 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.674588 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.674757 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.674868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.674999 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.675156 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.675313 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.675474 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.675744 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.675845 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.676064 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.676154 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.676412 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.676578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.676731 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.676904 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.677041 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.677220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.677358 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.677699 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.677840 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.678016 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.678283 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.678387 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.678605 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.678705 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.679051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.679155 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.679241 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.679330 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.679529 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.679628 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.679919 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.680049 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.680154 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.680317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.680469 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.680601 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.680792 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.680918 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.681106 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.681236 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.681419 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.681554 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.681766 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.681910 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.682079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.682227 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.682403 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.682544 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.682715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.682875 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.683072 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.683262 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.683403 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.683579 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.683714 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.683994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.684132 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.684319 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.684432 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.684629 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.684746 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.684942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.685049 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.685250 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.685351 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.685555 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.685697 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.685893 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.685994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.686209 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.686317 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.686519 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.686628 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.686828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.686934 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.687132 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.687240 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.687442 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.687541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.687747 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.687854 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.688054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.688160 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.688358 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.688465 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.688659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.688758 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.688958 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.689062 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.689278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.689379 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.689681 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.689795 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.689946 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.690051 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.690239 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.690346 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.690546 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.690652 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.690867 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:35:48.690974 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.691209 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.691308 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.691544 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.691644 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.691864 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.691976 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.692191 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.692288 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.692523 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.692619 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.692847 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.692945 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.693167 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.693280 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.693476 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.693620 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.693823 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.693918 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.694160 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.694275 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.694457 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.694569 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.694770 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.694870 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.695081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.695181 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.695404 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.695517 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.695727 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.695831 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.696046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.696148 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.696366 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.696466 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.696687 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.696840 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.697000 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.697101 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.697310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.697401 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.697660 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.697774 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.697991 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.698082 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.698309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.698409 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.699278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.699385 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.699503 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.699902 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.700291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.700556 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.700668 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.700888 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.700978 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.701226 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.701308 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.701542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.701654 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.701988 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.702093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.702240 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.702312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.702518 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.702610 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.702858 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.702938 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.703239 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.703332 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.703507 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.703603 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.703833 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.703912 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.705193 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.705300 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.705393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.705479 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.705552 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.705668 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.705751 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.705823 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.705905 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.705905 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.706040 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.706126 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.706231 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.706370 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.706631 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.706738 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.706996 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.707090 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.707573 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.707698 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.707794 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.707884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.707981 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.708072 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.708238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.708346 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.708550 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.708665 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.708859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.708989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.709194 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.709330 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.709515 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.709683 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.709956 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.710073 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.710228 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.710511 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.710624 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.710718 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.710809 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.710897 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.711148 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.711259 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.711453 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.711542 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.711771 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.711853 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.712094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.712200 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.712401 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.712495 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.712712 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.712850 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.713027 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.713127 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.713339 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.713436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.713673 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.713784 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.714055 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.714295 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.714920 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.715018 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.715280 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.715435 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.715544 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.715630 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.715872 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.715983 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.716128 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.716235 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.716450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.716549 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.716770 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.716873 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.717089 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.717195 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.717411 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.717499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.717739 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.717847 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.718070 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.718214 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.718390 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.718488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.718704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.718793 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.719022 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.719124 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.719353 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.719442 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.719668 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.719797 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.720077 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.720182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.720313 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.720404 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.720714 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.720835 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.720932 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.721017 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.721250 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.721355 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.721558 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.721696 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.721893 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.721986 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.722214 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.722327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.722519 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.722610 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.722822 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.722982 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.723133 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.723232 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.723439 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.723550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.723744 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.723846 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.724052 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.724143 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.724364 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.724464 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.724673 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.724771 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.724981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.725077 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.725287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.725404 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.725618 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.725728 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.725941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.726038 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.726254 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.726359 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.726566 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.726665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.726878 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.726981 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.727229 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.727327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.727544 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.727641 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.727859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.727949 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.728182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.728275 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.728500 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.728597 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.728820 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.728911 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.729140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.729232 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.729459 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.729680 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.729943 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.730034 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.730208 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.730353 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.730536 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.730746 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.730857 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.731139 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.731254 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.731479 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.731591 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.731800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.731891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.732110 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.732249 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.732431 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.732524 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.732759 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.732849 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.733081 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.733180 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.733403 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.733501 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.733739 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.733832 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.734068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.734161 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.734384 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.734474 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.734703 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.734839 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.735025 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.735134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.735392 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.735551 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.735664 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.735970 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.736290 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.736560 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.736900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.736900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.737230 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.737523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.737877 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.738187 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.738538 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.738839 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.739058 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.739202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.739482 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.739725 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.739845 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.740085 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.740195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.740472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.740578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.740986 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.741087 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.741171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.741260 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.741335 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.741650 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.741752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.741826 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.742048 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.742157 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.742295 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.742455 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.742779 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.742886 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.743102 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.743210 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.743415 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.743520 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.743735 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.743883 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.744046 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.744158 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.744357 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.744461 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.744667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.744833 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.745006 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.745179 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.745377 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.745704 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.745855 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.746039 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.746137 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.746364 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.746445 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.746672 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.746753 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.746984 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.747075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.747325 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.747413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.747732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.747842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.747952 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.748093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.748264 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.748576 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.748775 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.748930 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.749111 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.749251 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.749538 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.749658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.749914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.750244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.750354 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.750562 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.750661 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.750901 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.751033 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.751215 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.751325 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.751531 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.751624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.751857 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.751957 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.752177 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.752281 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.752493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.752593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.753202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.753321 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.753407 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.753505 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.753632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.753709 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.753804 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.754083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.754401 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.754531 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.754722 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.755436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.755536 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.755622 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.755799 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.755894 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.755985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.755985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.756446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.756576 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.756840 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.757042 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.757146 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.757232 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.757470 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.757598 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.757867 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.757983 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.758195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.758304 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.758526 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.758625 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.758858 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.758981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.759177 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.759282 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.759487 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.759586 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.759804 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.759904 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.760115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.760219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.760520 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.760639 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.760888 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.761010 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.761751 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.761831 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.762072 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.762194 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.762387 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.762534 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.762705 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.762811 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.763021 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.763144 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.763333 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.763449 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.763643 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.763744 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.763957 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.764057 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.764275 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.764380 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.764586 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.764686 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.764905 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.765172 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.765264 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.765518 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.765632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.765872 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.765973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.766182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.766289 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.766494 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.766649 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.766807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.766920 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.767157 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.767301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.767469 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.767563 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.767813 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.767969 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.768113 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.768201 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.768427 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.768522 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.768742 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.768844 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.769057 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.769165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.769373 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.769472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.769706 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.769818 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.770017 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.770177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.770327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.770457 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.770643 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.770736 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.770958 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.771068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.771271 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.771364 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.771577 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.771677 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.771894 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.772008 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.772201 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.772293 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.772514 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.772668 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.772864 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.772970 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.773177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.773296 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.773544 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.773664 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.773847 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.773959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.774157 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.774267 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.774466 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.774553 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.774774 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.774880 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.775091 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.775197 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.775404 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.775505 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.775713 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.775807 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.776028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.776134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.776337 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.776428 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.776656 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.777408 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.777621 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.777744 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.777868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.777988 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.778210 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.778308 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.778524 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.778619 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.778838 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.778931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.779203 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.779339 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.779532 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.779849 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.780159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.780373 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.781622 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.781826 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.782000 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.782177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.782344 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.782494 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.782661 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.782818 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.782982 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.783137 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.783395 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.783716 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.783874 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.783986 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.784074 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.784165 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.784251 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.784341 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.784433 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.784531 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.784624 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.784709 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.784709 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.784709 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.784918 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.785131 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.785300 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.785450 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.785917 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.786074 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.786231 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.786388 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.786527 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.786732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.786902 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.787049 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.787299 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.787435 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.787726 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.787854 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.787968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.788066 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.788244 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.788496 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.788636 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.788782 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.788925 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.789074 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.789231 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.789390 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.789551 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.789713 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.789874 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.790001 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.790200 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.790323 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.790515 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.790651 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.790832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.790982 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.791151 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.791315 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.791483 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.791648 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.791808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.791963 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.792121 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.792276 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.792483 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.792711 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.792814 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.793099 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.793192 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.793416 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.793546 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.793766 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.793900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.794083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.794226 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.794398 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.794501 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.794708 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.794817 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.795025 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.795127 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.795336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.795430 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.795665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.795860 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.795976 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.796069 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.796288 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.796379 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.796604 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.796708 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.796984 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.797091 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.797229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.797321 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.797547 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.797728 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.797899 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.798034 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.798211 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.798311 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.798533 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.798669 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.798851 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.798943 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.799170 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.799271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.799489 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.799581 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.799802 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.799892 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.800110 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.800201 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.800424 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.800523 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.800733 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.800862 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.801051 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.801149 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.801366 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.801467 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.801719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.801816 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.802037 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.802145 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.802351 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.802442 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.802668 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.802758 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.802976 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.803075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.803312 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.803418 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.803647 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.803774 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.803961 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.804149 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.804283 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.804388 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.804626 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.804732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.804919 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.805026 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.805236 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.805329 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.805554 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.805721 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.805898 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.806005 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.806222 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.806420 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.806548 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.806649 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.806869 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.806963 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.807191 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.807283 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.807510 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.807638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.807816 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.809897 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.810107 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.810270 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.810421 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.810570 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.810739 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.810908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.811059 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.811209 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.811422 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.811585 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.811749 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.811918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.812075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.812225 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.812382 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.812382 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.812786 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.812944 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.813099 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.813099 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.813447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.813447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.813647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.813734 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.813818 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.813912 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.814202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.814330 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.814419 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.814419 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.814419 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.814419 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.814733 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.814889 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.815219 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.815549 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.815872 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.816193 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.816505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.816834 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.817163 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.817485 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.817790 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.817942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.818256 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.818384 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.818589 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.818859 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.818978 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.819219 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.819351 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.819551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.819681 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.819863 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.820015 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.820174 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.820363 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.820491 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.821184 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.821319 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.821522 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.821723 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.821847 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.821966 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.822077 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.822194 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.822319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.822446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.822563 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.822674 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.822791 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.822952 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.823100 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.823257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.823381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.823700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.824659 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.824792 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.824916 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.825124 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.825291 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.825559 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.825849 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.825988 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.826187 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.826311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.826517 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.826686 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.826850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.826983 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.827342 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.827474 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.827673 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.827841 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.828040 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.828234 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.828416 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.828618 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.828983 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.829132 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.829278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.829548 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.829736 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.829910 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.830113 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.830266 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.830544 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.830676 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.830880 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.831115 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.831257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.831516 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.831661 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.831852 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.832090 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.832223 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.832457 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.832597 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.832774 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.833031 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.833163 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.833382 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.833770 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.833930 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.834062 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.834300 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.834437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.834840 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.834980 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.835121 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.835269 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.835511 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.835649 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.835837 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.836025 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.836170 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.836451 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.836645 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.836787 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.837058 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.837209 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.837411 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.837629 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.837858 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.838076 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.838206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.838395 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.838692 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.838831 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.839175 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.839364 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.839495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.839853 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.840049 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.840355 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.840498 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.840739 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.840879 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.841068 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.841282 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.841412 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.841728 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.841859 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.842063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.842256 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.842385 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.842700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.842838 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.843145 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.843287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.843591 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.843731 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.843967 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.844181 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.844321 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.844539 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.844869 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.845010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.845176 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.845391 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.845539 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.845831 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.845964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.846149 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.846359 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.846504 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.846790 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.846930 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.847121 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.847315 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.847448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.847770 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.847917 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.848096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.848266 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.848407 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.848756 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.848905 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.849044 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.849333 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.849483 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.849723 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.849856 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.850038 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.850320 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.850464 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.850667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.850803 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.850997 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.851304 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.851443 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.851623 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.851793 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.851933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.852333 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.852478 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.852702 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.852859 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.853020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.853342 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.853539 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.853721 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.854096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.854239 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.854368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.854626 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.854770 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.855106 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.855368 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.855512 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.855787 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.855926 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.856258 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.856388 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.856810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.857025 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.857181 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.857473 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.857750 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.857898 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.858027 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.858821 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.859178 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.859421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.859673 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.859806 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.859941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.860068 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.860068 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.860331 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.860468 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.860468 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.860715 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.860840 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.860975 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.861162 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.861162 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.861618 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.861763 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.861902 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.862044 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.862044 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.862338 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.862542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.862686 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.862816 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.863049 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.863189 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.863380 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.863544 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.863715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.864043 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.864201 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.864542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.864730 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.864877 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.865021 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.865327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.865461 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.865642 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.865912 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.866045 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.866275 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.866424 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.866588 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.866942 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.867080 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.867351 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.867481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.867664 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.867894 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.868033 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.868277 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.868407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.868611 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.868837 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.868972 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.869226 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.869365 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.869535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.869827 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.869977 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.870196 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.870994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.871216 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.871415 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.871608 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.871820 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.872065 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.872251 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.872441 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.872572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.872760 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.873008 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.873159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.873379 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.873513 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.873718 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.873987 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.874133 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.874493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.874814 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.874945 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.875128 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.875448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.875585 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.875751 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.876022 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.876197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.876377 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.876539 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.876693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.876991 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.877124 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.877353 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.877504 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.877716 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.877938 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.878287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.878420 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.878626 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.878819 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.878959 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.879336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.879487 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.879625 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.879767 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.879911 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.880192 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.880335 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.880499 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.880821 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.880967 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.881137 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.881354 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.881488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.881806 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.881949 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.882125 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.882338 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.882486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.882745 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.882875 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.883062 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.883269 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.883402 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.883679 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.883816 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.883993 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.884307 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.884627 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.884775 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.884940 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.885134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.885276 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.885657 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.885841 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.885976 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.886788 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.886984 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.887181 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.887362 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.887504 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.887736 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.887877 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.888120 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.888370 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.888502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.888685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.888899 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.889030 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.889305 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.889553 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.889708 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.889885 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.890027 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.890296 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.890446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.890733 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.890949 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.891097 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.891361 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.891497 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.891694 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.891906 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.892045 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.892323 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.892462 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.892650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.892867 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.893003 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.893407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.893554 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.893916 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.894063 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.894194 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.894441 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.894863 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.895403 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.896273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.896420 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.896551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.896679 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.896815 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.897000 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.897132 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.897132 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.897467 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.897619 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.897619 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.897886 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.898025 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.898198 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.898340 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.898569 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.898704 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.898887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.899142 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.899275 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.899511 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.899756 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.899889 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.900062 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.900204 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.900482 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.900628 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.900758 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.901005 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.901192 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.901333 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.901633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.902388 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.902533 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.902714 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.902862 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.903091 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.903223 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.903405 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.903629 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.903762 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.904012 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.904143 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.904323 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.904635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.904799 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.905041 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.905298 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.905652 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.905798 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.906041 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.906283 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.906414 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.906603 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.906735 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.906917 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.907188 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.907320 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.907552 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.907711 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.907885 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.908177 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.908308 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.908517 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.908668 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.908834 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.909111 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.909250 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.909455 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.909626 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.909786 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.910064 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.910198 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.910402 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.910908 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.911050 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.911315 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.911449 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.911617 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.911861 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.911994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.912257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.912396 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.912584 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.912789 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.912931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.913215 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.913366 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.913546 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.913898 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.914219 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.914609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.914848 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.915166 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.915620 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.915933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.916165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.916320 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.916551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.916720 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.916859 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.917053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.917543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.918319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.918471 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.918601 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.918936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.919083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.919216 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.919491 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.919637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.919775 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.920079 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.920222 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.920439 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.920581 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.920757 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.920941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.921200 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.921377 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.921634 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.921788 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:35:48.922069 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.922463 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.922940 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.923303 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.923650 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.924042 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.924439 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.924829 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.925279 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.925801 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.926608 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.926943 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.927350 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.927760 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.928156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.928561 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.928958 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.929357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.929824 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.930231 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.930893 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.931484 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.931891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.932347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.932732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.933913 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.934453 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.934850 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.935441 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.935664 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.936062 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.936776 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.937176 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.937590 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.937991 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.938389 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.938834 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.939187 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.939718 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.939976 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.940372 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.940767 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.941160 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.941566 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.942156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.942564 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.942964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.943365 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.943803 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.944158 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.944565 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.944956 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.945349 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.945804 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.946218 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.946880 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.947276 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.947795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.948191 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.949526 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.949702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.950095 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.950636 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.950999 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.951404 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.951807 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.952401 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.952740 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.953167 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.953736 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.954143 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.954531 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.956002 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.956002 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.956002 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.956002 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.956509 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.957137 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.957534 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.957961 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.958351 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.958734 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.959150 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.959528 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.959923 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.960309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.960696 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.961096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.961676 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.962068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.962590 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.963031 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.963374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.963763 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.964154 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.964602 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.964988 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.965424 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.965860 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.966258 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.966677 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.967309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.967715 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.968108 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.968512 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.968920 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.969321 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.969741 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.970156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.970549 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.970945 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.971348 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.971852 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.972262 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.972780 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.973188 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.973624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.974012 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.974412 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.974811 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.975213 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.975609 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.976003 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.976414 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.976807 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.977411 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.977828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.978225 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.978617 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.979019 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.979414 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.979855 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.980246 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.980641 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.981130 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.981542 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.982053 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.982478 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.983016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.983448 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.983844 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.984374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.984684 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.985077 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.985470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.985883 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:35:48.986038 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO dbcounter [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] Registered counter for database nova_api Sep 01 17:35:48.986275 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:35:49.013737 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_db.sqlalchemy.engines [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:35:49.021847 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writer thread running {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:35:49.053101 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO dbcounter [None req-212105b5-c256-4794-a625-aac2115cb020 None None] Registered counter for database nova_api Sep 01 17:35:49.075008 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_db.sqlalchemy.engines [None req-212105b5-c256-4794-a625-aac2115cb020 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:35:49.079597 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.context [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e69bc69-0465-4e2e-a814-7702ef293021(cell1) {{(pid=127233) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 17:35:49.081768 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writer thread running {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:35:49.083639 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:49.084122 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:49.085736 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:49.086460 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:49.086902 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:49.088894 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:49.091530 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO dbcounter [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] Registered counter for database nova_cell0 Sep 01 17:35:49.095654 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO dbcounter [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] Registered counter for database nova_cell1 Sep 01 17:35:49.103526 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_db.sqlalchemy.engines [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:35:49.106772 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_db.sqlalchemy.engines [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:35:49.114868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writer thread running {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:35:49.115203 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writer thread running {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:35:49.141241 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.context [None req-212105b5-c256-4794-a625-aac2115cb020 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e69bc69-0465-4e2e-a814-7702ef293021(cell1) {{(pid=127232) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 17:35:49.145399 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-212105b5-c256-4794-a625-aac2115cb020 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:49.145971 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-212105b5-c256-4794-a625-aac2115cb020 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:49.147684 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-212105b5-c256-4794-a625-aac2115cb020 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:49.148463 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-212105b5-c256-4794-a625-aac2115cb020 None None] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:49.148917 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-212105b5-c256-4794-a625-aac2115cb020 None None] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:49.151016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-212105b5-c256-4794-a625-aac2115cb020 None None] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:49.154060 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO dbcounter [None req-212105b5-c256-4794-a625-aac2115cb020 None None] Registered counter for database nova_cell0 Sep 01 17:35:49.158385 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO dbcounter [None req-212105b5-c256-4794-a625-aac2115cb020 None None] Registered counter for database nova_cell1 Sep 01 17:35:49.166477 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_db.sqlalchemy.engines [None req-212105b5-c256-4794-a625-aac2115cb020 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:35:49.170622 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_db.sqlalchemy.engines [None req-212105b5-c256-4794-a625-aac2115cb020 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:35:49.175716 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writer thread running {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:35:49.181016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writer thread running {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:35:49.267149 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO dbcounter [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] Registered counter for database nova_cell0 Sep 01 17:35:49.273766 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_db.sqlalchemy.engines [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:35:49.278892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writer thread running {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:35:49.328419 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO dbcounter [None req-212105b5-c256-4794-a625-aac2115cb020 None None] Registered counter for database nova_cell0 Sep 01 17:35:49.337085 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_db.sqlalchemy.engines [None req-212105b5-c256-4794-a625-aac2115cb020 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:35:49.342391 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writer thread running {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:35:49.598442 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: WARNING keystonemiddleware.auth_token [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:35:49.606287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: WARNING keystonemiddleware.auth_token [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:35:49.666226 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: WARNING keystonemiddleware.auth_token [None req-212105b5-c256-4794-a625-aac2115cb020 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:35:49.674461 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: WARNING keystonemiddleware.auth_token [None req-212105b5-c256-4794-a625-aac2115cb020 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:35:49.953438 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: WARNING keystonemiddleware.auth_token [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:35:49.959696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: WARNING keystonemiddleware.auth_token [None req-92583e1d-dde3-4f71-9964-c6fba865cd25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:35:49.965449 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ecc96199c0 pid: 127233 (default app) Sep 01 17:35:50.025692 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: WARNING keystonemiddleware.auth_token [None req-212105b5-c256-4794-a625-aac2115cb020 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:35:50.032228 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: WARNING keystonemiddleware.auth_token [None req-212105b5-c256-4794-a625-aac2115cb020 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:35:50.037930 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ecc96199c0 pid: 127232 (default app) Sep 01 17:36:26.712389 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=3 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:26.713681 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=3 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:26.714479 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=3 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:26.715442 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=3 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:27.302374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=3 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:27.303805 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=3 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:27.304578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=3 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:27.305350 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=3 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:27.922744 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1fe070c5-fc82-486f-af99-1d5327b8971c tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] Action: 'create', calling method: .version_select at 0x7f354b6151f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1786151573", "metadata": {"Type": "work"}}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:28.844720 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e2c5b5cf-bc49-4eb9-8c6f-0284f8563b21 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Action: 'create', calling method: .version_select at 0x7f354b6171f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1224432128", "metadata": {"Type": "work"}}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e2c5b5cf-bc49-4eb9-8c6f-0284f8563b21 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Request method failure captured: Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 122 Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO2bdkyC-0kMnQ9uQull8NeJgcTKeysWjL4ZpNNfZW4ofZ4svF6CJQsaclOFgRuKt2rOL9Z59LEoG7IORvvBrvaeRrKUvqosr3o40f4dZISCR81eDze0c-GvPLNBA21fRHlTNfGTr4wBuNf0ZOq9U0eDrfHmmSBO9n4uicpd4gx-CxQ Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 49ce77df03d34465a8d809e9c82fb42f Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:36:28.851659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:36:28.853327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:36:28.853327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:28.853327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 49ce77df03d34465a8d809e9c82fb42f Sep 01 17:36:28.853327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:28.853327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-VolumesNegativeTest-1108061182-project Sep 01 17:36:28.853327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:36:28.853327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:36:28.853327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: 781a9b0e524c46fc89908e1a1bc4c14c Sep 01 17:36:28.853327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-VolumesNegativeTest-1108061182-project Sep 01 17:36:28.853327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Sep 01 17:36:28.853327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1224432128", "metadata": {"Type": "work"}}} Sep 01 17:36:28.853327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: Sep 01 17:36:28.853327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1224432128', 'metadata': {'Type': 'work'}}}} Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise error Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:36:28.854357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 17:36:28.857093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 17:36:28.858777 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 17:36:28.858777 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:28.859748 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e2c5b5cf-bc49-4eb9-8c6f-0284f8563b21 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:36:28.861502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e2c5b5cf-bc49-4eb9-8c6f-0284f8563b21 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.564835 Sep 01 17:36:28.862737 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 1/1] 10.222.0.100 () {60 vars in 1161 bytes} [Thu Sep 1 17:36:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1567 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:36:29.404004 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e1632cc2-f56d-4e68-85a8-5292410b664c tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Action: 'create', calling method: .version_select at 0x7f354b617ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-423560192"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:29.986053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1fe070c5-fc82-486f-af99-1d5327b8971c tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.285982 Sep 01 17:36:29.987343 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 1/2] 10.222.0.100 () {60 vars in 1161 bytes} [Thu Sep 1 17:36:26 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3289 msecs (HTTP/1.1 200) 10 headers in 449 bytes (2 switches on core 0) Sep 01 17:36:30.010001 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e206c2d9-db33-44f1-8fb0-3f63d7fab0a9 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Action: 'create', calling method: .version_select at 0x7f354b4f9040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-245046204", "metadata": {"Type": "work"}}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e206c2d9-db33-44f1-8fb0-3f63d7fab0a9 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Request method failure captured: Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 119 Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2bdkyC-0kMnQ9uQull8NeJgcTKeysWjL4ZpNNfZW4ofZ4svF6CJQsaclOFgRuKt2rOL9Z59LEoG7IORvvBrvaeRrKUvqosr3o40f4dZISCR81eDze0c-GvPLNBA21fRHlTNfGTr4wBuNf0ZOq9U0eDrfHmmSBO9n4uicpd4gx-CxQ Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 49ce77df03d34465a8d809e9c82fb42f Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:36:30.022257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:36:30.023881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:36:30.023881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:30.023881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 49ce77df03d34465a8d809e9c82fb42f Sep 01 17:36:30.023881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:30.023881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-VolumesNegativeTest-1108061182-project Sep 01 17:36:30.023881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:36:30.023881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:36:30.023881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: 781a9b0e524c46fc89908e1a1bc4c14c Sep 01 17:36:30.023881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-VolumesNegativeTest-1108061182-project Sep 01 17:36:30.023881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Sep 01 17:36:30.023881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-245046204", "metadata": {"Type": "work"}}} Sep 01 17:36:30.023881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: Sep 01 17:36:30.023881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-245046204', 'metadata': {'Type': 'work'}}}} Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise error Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi '0' Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:36:30.024866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 17:36:30.026165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 17:36:30.027738 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 17:36:30.027738 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.043276 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e206c2d9-db33-44f1-8fb0-3f63d7fab0a9 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:36:30.044756 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e206c2d9-db33-44f1-8fb0-3f63d7fab0a9 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.045712 Sep 01 17:36:30.045554 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 2/3] 10.222.0.100 () {60 vars in 1161 bytes} [Thu Sep 1 17:36:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:36:30.051717 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4496f822-eee9-4e65-aa1f-dd8f251cb4d7 tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] Calling method '.version_select at 0x7f354b49ba60>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:30.679415 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4496f822-eee9-4e65-aa1f-dd8f251cb4d7 tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a" status: 200 len: 353 microversion: 2.1 time: 0.632365 Sep 01 17:36:30.680171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 3/4] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:36:30 2022] GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a => generated 353 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:30.693692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-baefb147-5e96-4e18-99a9-fb2e4e115359 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Action: 'create', calling method: .version_select at 0x7f354b4f9b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1682970468", "metadata": {"Type": "work"}}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-baefb147-5e96-4e18-99a9-fb2e4e115359 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Request method failure captured: Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 119 Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2bdkyC-0kMnQ9uQull8NeJgcTKeysWjL4ZpNNfZW4ofZ4svF6CJQsaclOFgRuKt2rOL9Z59LEoG7IORvvBrvaeRrKUvqosr3o40f4dZISCR81eDze0c-GvPLNBA21fRHlTNfGTr4wBuNf0ZOq9U0eDrfHmmSBO9n4uicpd4gx-CxQ Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 49ce77df03d34465a8d809e9c82fb42f Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:36:30.703182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:36:30.704936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:36:30.704936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:30.704936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 49ce77df03d34465a8d809e9c82fb42f Sep 01 17:36:30.704936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:30.704936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-VolumesNegativeTest-1108061182-project Sep 01 17:36:30.704936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:36:30.704936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:36:30.704936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: 781a9b0e524c46fc89908e1a1bc4c14c Sep 01 17:36:30.704936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-VolumesNegativeTest-1108061182-project Sep 01 17:36:30.704936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Sep 01 17:36:30.704936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1682970468", "metadata": {"Type": "work"}}} Sep 01 17:36:30.704936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: Sep 01 17:36:30.704936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1682970468', 'metadata': {'Type': 'work'}}}} Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise error Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi '' Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:36:30.705996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 17:36:30.707929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 17:36:30.709230 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 17:36:30.709230 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:30.712331 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-baefb147-5e96-4e18-99a9-fb2e4e115359 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:36:30.715268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-baefb147-5e96-4e18-99a9-fb2e4e115359 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026381 Sep 01 17:36:30.717941 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 4/5] 10.222.0.100 () {60 vars in 1161 bytes} [Thu Sep 1 17:36:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:36:30.733059 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e9b99fc1-146f-46c3-aa87-85ff2bda8fa1 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Calling method '.version_select at 0x7f354b49bc10>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:30.950371 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e1632cc2-f56d-4e68-85a8-5292410b664c tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.085689 Sep 01 17:36:30.957623 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 2/6] 10.222.0.100 () {60 vars in 1160 bytes} [Thu Sep 1 17:36:28 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2089 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Sep 01 17:36:30.974548 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9200dae8-ff95-431b-99e3-dc5b6e0dbeb7 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b4a6670>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:30.998708 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-e9b99fc1-146f-46c3-aa87-85ff2bda8fa1 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] HTTP exception thrown: Volume tempest-invalid-1876720499 could not be found. Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e9b99fc1-146f-46c3-aa87-85ff2bda8fa1 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Request method failure captured: Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1876720499 HTTP/1.1 Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2bdkyC-0kMnQ9uQull8NeJgcTKeysWjL4ZpNNfZW4ofZ4svF6CJQsaclOFgRuKt2rOL9Z59LEoG7IORvvBrvaeRrKUvqosr3o40f4dZISCR81eDze0c-GvPLNBA21fRHlTNfGTr4wBuNf0ZOq9U0eDrfHmmSBO9n4uicpd4gx-CxQ Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 49ce77df03d34465a8d809e9c82fb42f Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:36:31.002480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:36:31.004083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:36:31.004083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:31.004083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 49ce77df03d34465a8d809e9c82fb42f Sep 01 17:36:31.004083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:31.004083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-VolumesNegativeTest-1108061182-project Sep 01 17:36:31.004083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:36:31.004083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:36:31.004083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: 781a9b0e524c46fc89908e1a1bc4c14c Sep 01 17:36:31.004083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-VolumesNegativeTest-1108061182-project Sep 01 17:36:31.004083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: Sep 01 17:36:31.004083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Volume tempest-invalid-1876720499 could not be found. Sep 01 17:36:31.004083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': 'tempest-invalid-1876720499'} Sep 01 17:36:31.004083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1876720499 could not be found. (HTTP 404) (Request-ID: req-75197746-1ae7-46d7-a1e3-5cfc6b4bc9ac) Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:31.005020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 17:36:31.006443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1876720499 could not be found. Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:36:31.007613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1876720499 could not be found. Sep 01 17:36:31.009310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.009310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:31.009310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.009310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:31.009310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:31.009310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:31.009310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:36:31.009310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:36:31.009310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1876720499 could not be found. Sep 01 17:36:31.009310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.009310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e9b99fc1-146f-46c3-aa87-85ff2bda8fa1 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Returning 404 to user: Volume tempest-invalid-1876720499 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:36:31.009310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e9b99fc1-146f-46c3-aa87-85ff2bda8fa1 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1876720499" status: 404 len: 99 microversion: 2.1 time: 0.281334 Sep 01 17:36:31.009310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 5/7] 10.222.0.100 () {58 vars in 1223 bytes} [Thu Sep 1 17:36:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1876720499 => generated 99 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 17:36:31.022758 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2a225d00-1fbc-4b3b-ae77-11cd11b385c4 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005568 Sep 01 17:36:31.024506 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 6/8] 10.222.0.100 () {58 vars in 1145 bytes} [Thu Sep 1 17:36:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 17:36:31.040872 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-62bffe15-db21-48c6-9401-50e0f5fedb08 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014879 Sep 01 17:36:31.049701 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 7/9] 10.222.0.100 () {58 vars in 1142 bytes} [Thu Sep 1 17:36:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 17:36:31.062547 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-13062c5a-da5e-4c18-9d5e-b47e31adbc27 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Calling method '.version_select at 0x7f354b40e160>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:31.203710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9200dae8-ff95-431b-99e3-dc5b6e0dbeb7 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f" status: 200 len: 345 microversion: 2.1 time: 0.240293 Sep 01 17:36:31.205392 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 3/10] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:36:30 2022] GET /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f => generated 345 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:31.220996 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f103e73b-863b-4520-9da2-014a0723ce02 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Action: 'create', calling method: .version_select at 0x7f354b4a6ca0>, body: {"snapshot": {"volume_id": "137a224e-fabf-4d27-a487-48b6087f032f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-12142297"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:31.250985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-13062c5a-da5e-4c18-9d5e-b47e31adbc27 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] HTTP exception thrown: Volume 6e9b1afd-e63a-4aad-afaf-4f1dcddbf942 could not be found. Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-13062c5a-da5e-4c18-9d5e-b47e31adbc27 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Request method failure captured: Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: DELETE /compute/v2.1/os-volumes/6e9b1afd-e63a-4aad-afaf-4f1dcddbf942 HTTP/1.1 Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2bdkyC-0kMnQ9uQull8NeJgcTKeysWjL4ZpNNfZW4ofZ4svF6CJQsaclOFgRuKt2rOL9Z59LEoG7IORvvBrvaeRrKUvqosr3o40f4dZISCR81eDze0c-GvPLNBA21fRHlTNfGTr4wBuNf0ZOq9U0eDrfHmmSBO9n4uicpd4gx-CxQ Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 49ce77df03d34465a8d809e9c82fb42f Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:36:31.253117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:36:31.254635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:36:31.254635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:31.254635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 49ce77df03d34465a8d809e9c82fb42f Sep 01 17:36:31.254635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:31.254635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-VolumesNegativeTest-1108061182-project Sep 01 17:36:31.254635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:36:31.254635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:36:31.254635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: 781a9b0e524c46fc89908e1a1bc4c14c Sep 01 17:36:31.254635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-VolumesNegativeTest-1108061182-project Sep 01 17:36:31.254635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: Sep 01 17:36:31.254635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Volume 6e9b1afd-e63a-4aad-afaf-4f1dcddbf942 could not be found. Sep 01 17:36:31.254635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '6e9b1afd-e63a-4aad-afaf-4f1dcddbf942'} Sep 01 17:36:31.254635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e9b1afd-e63a-4aad-afaf-4f1dcddbf942 could not be found. (HTTP 404) (Request-ID: req-06e00f8a-66dd-4d67-ad0f-ae05dbde8f84) Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:31.255548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 17:36:31.256861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e9b1afd-e63a-4aad-afaf-4f1dcddbf942 could not be found. Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 17:36:31.258173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:36:31.259685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e9b1afd-e63a-4aad-afaf-4f1dcddbf942 could not be found. Sep 01 17:36:31.259685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.259685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:31.259685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.259685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:31.259685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:31.259685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:31.259685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:36:31.259685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:36:31.259685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e9b1afd-e63a-4aad-afaf-4f1dcddbf942 could not be found. Sep 01 17:36:31.259685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.262015 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-13062c5a-da5e-4c18-9d5e-b47e31adbc27 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Returning 404 to user: Volume 6e9b1afd-e63a-4aad-afaf-4f1dcddbf942 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:36:31.263171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-13062c5a-da5e-4c18-9d5e-b47e31adbc27 tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/6e9b1afd-e63a-4aad-afaf-4f1dcddbf942" status: 404 len: 109 microversion: 2.1 time: 0.208496 Sep 01 17:36:31.263898 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 8/11] 10.222.0.100 () {58 vars in 1253 bytes} [Thu Sep 1 17:36:31 2022] DELETE /compute/v2.1/os-volumes/6e9b1afd-e63a-4aad-afaf-4f1dcddbf942 => generated 109 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:36:31.275667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f90cdeea-9e6e-4eff-b966-99f5fc71af5b tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Calling method '.version_select at 0x7f354b49bd30>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:31.384102 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-f90cdeea-9e6e-4eff-b966-99f5fc71af5b tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] HTTP exception thrown: Volume 69a013e5-96bd-4fb9-adf5-b7f37ae13d10 could not be found. Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f90cdeea-9e6e-4eff-b966-99f5fc71af5b tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Request method failure captured: Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/os-volumes/69a013e5-96bd-4fb9-adf5-b7f37ae13d10 HTTP/1.1 Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2bdkyC-0kMnQ9uQull8NeJgcTKeysWjL4ZpNNfZW4ofZ4svF6CJQsaclOFgRuKt2rOL9Z59LEoG7IORvvBrvaeRrKUvqosr3o40f4dZISCR81eDze0c-GvPLNBA21fRHlTNfGTr4wBuNf0ZOq9U0eDrfHmmSBO9n4uicpd4gx-CxQ Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 49ce77df03d34465a8d809e9c82fb42f Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:36:31.386953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:36:31.388480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/49ce77df03d34465a8d809e9c82fb42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:36:31.388480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:31.388480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 49ce77df03d34465a8d809e9c82fb42f Sep 01 17:36:31.388480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-VolumesNegativeTest-1108061182 Sep 01 17:36:31.388480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-VolumesNegativeTest-1108061182-project Sep 01 17:36:31.388480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:36:31.388480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:36:31.388480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: 781a9b0e524c46fc89908e1a1bc4c14c Sep 01 17:36:31.388480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-VolumesNegativeTest-1108061182-project Sep 01 17:36:31.388480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: Sep 01 17:36:31.388480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Volume 69a013e5-96bd-4fb9-adf5-b7f37ae13d10 could not be found. Sep 01 17:36:31.388480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '69a013e5-96bd-4fb9-adf5-b7f37ae13d10'} Sep 01 17:36:31.388480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69a013e5-96bd-4fb9-adf5-b7f37ae13d10 could not be found. (HTTP 404) (Request-ID: req-b8fc6135-e02c-407f-9f08-3b9c261665e3) Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:31.389238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:36:31.390923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69a013e5-96bd-4fb9-adf5-b7f37ae13d10 could not be found. Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 17:36:31.392002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69a013e5-96bd-4fb9-adf5-b7f37ae13d10 could not be found. Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69a013e5-96bd-4fb9-adf5-b7f37ae13d10 could not be found. Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f90cdeea-9e6e-4eff-b966-99f5fc71af5b tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] Returning 404 to user: Volume 69a013e5-96bd-4fb9-adf5-b7f37ae13d10 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f90cdeea-9e6e-4eff-b966-99f5fc71af5b tempest-VolumesNegativeTest-1108061182 tempest-VolumesNegativeTest-1108061182-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/69a013e5-96bd-4fb9-adf5-b7f37ae13d10" status: 404 len: 109 microversion: 2.1 time: 0.117555 Sep 01 17:36:31.393088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 9/12] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:36:31 2022] GET /compute/v2.1/os-volumes/69a013e5-96bd-4fb9-adf5-b7f37ae13d10 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:36:31.700356 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-fbeec3af-c46a-4968-9db3-ea38a980b355 tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] Calling method '.version_select at 0x7f354b40ea60>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:31.845782 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-fbeec3af-c46a-4968-9db3-ea38a980b355 tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a" status: 200 len: 354 microversion: 2.1 time: 0.153780 Sep 01 17:36:31.846372 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 10/13] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:36:31 2022] GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a => generated 354 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:36:31.860535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7c385789-6afd-4ffe-915f-d88b9d9bad1b tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] Calling method '.version_select at 0x7f354b418160>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:32.070437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7c385789-6afd-4ffe-915f-d88b9d9bad1b tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a" status: 200 len: 354 microversion: 2.1 time: 0.212612 Sep 01 17:36:32.070437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 11/14] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:36:31 2022] GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a => generated 354 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:36:32.071664 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f103e73b-863b-4520-9da2-014a0723ce02 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.856361 Sep 01 17:36:32.072312 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 4/15] 10.222.0.100 () {60 vars in 1167 bytes} [Thu Sep 1 17:36:31 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:36:32.100199 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-98d972f0-9fca-46e0-8beb-055e22927fc6 tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] Calling method '.version_select at 0x7f354b4a6b80>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:32.106774 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b6afedea-5898-4d72-b00f-c7dac3a3fdcd tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b40e3a0>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:32.298048 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-98d972f0-9fca-46e0-8beb-055e22927fc6 tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a" status: 202 len: 0 microversion: 2.1 time: 0.202601 Sep 01 17:36:32.298623 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 5/16] 10.222.0.100 () {58 vars in 1253 bytes} [Thu Sep 1 17:36:32 2022] DELETE /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 17:36:32.314360 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-398c7866-f7c9-4aec-be4e-558cab6e29aa tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] Calling method '.version_select at 0x7f354b4a6430>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:32.389536 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-b6afedea-5898-4d72-b00f-c7dac3a3fdcd tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3" status: 200 len: 285 microversion: 2.1 time: 0.286825 Sep 01 17:36:32.390655 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 12/17] 10.222.0.100 () {58 vars in 1256 bytes} [Thu Sep 1 17:36:32 2022] GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3 => generated 285 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:32.406125 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-11f55532-befb-453a-a151-10dd1ec64390 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b49b9d0>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:32.585161 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-398c7866-f7c9-4aec-be4e-558cab6e29aa tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a" status: 200 len: 353 microversion: 2.1 time: 0.275642 Sep 01 17:36:32.587533 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 6/18] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:36:32 2022] GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a => generated 353 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:32.710960 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-11f55532-befb-453a-a151-10dd1ec64390 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.312846 Sep 01 17:36:32.711583 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 13/19] 10.222.0.100 () {58 vars in 1145 bytes} [Thu Sep 1 17:36:32 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:32.727623 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-1e671050-8278-45e8-bc25-0c831d3b779f tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b4ba310>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:32.926808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-1e671050-8278-45e8-bc25-0c831d3b779f tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3" status: 200 len: 285 microversion: 2.1 time: 0.206408 Sep 01 17:36:32.927877 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 7/20] 10.222.0.100 () {58 vars in 1256 bytes} [Thu Sep 1 17:36:32 2022] GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3 => generated 285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:33.601346 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-41cd6f0b-47c1-42d2-a22f-b27afc3667a2 tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] Calling method '.version_select at 0x7f354b418a60>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:33.761554 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-41cd6f0b-47c1-42d2-a22f-b27afc3667a2 tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a" status: 200 len: 353 microversion: 2.1 time: 0.164022 Sep 01 17:36:33.767907 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 14/21] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:36:33 2022] GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a => generated 353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:33.940524 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8d65eeaf-d12a-4973-a4bb-3edec7d59e24 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b4a6670>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:34.010782 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8d65eeaf-d12a-4973-a4bb-3edec7d59e24 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3" status: 200 len: 285 microversion: 2.1 time: 0.074232 Sep 01 17:36:34.012044 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 8/22] 10.222.0.100 () {58 vars in 1256 bytes} [Thu Sep 1 17:36:33 2022] GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3 => generated 285 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:34.787587 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-dde8b514-a6d8-4e3d-84c7-ad8f10993250 tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] Calling method '.version_select at 0x7f354b49b9d0>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:34.939879 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-dde8b514-a6d8-4e3d-84c7-ad8f10993250 tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a" status: 200 len: 353 microversion: 2.1 time: 0.156427 Sep 01 17:36:34.940757 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 15/23] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:36:34 2022] GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:35.039098 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-99aba9db-b83f-42b1-9bc3-f55f4c4741ad tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b4a6ee0>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:35.119635 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-99aba9db-b83f-42b1-9bc3-f55f4c4741ad tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3" status: 200 len: 285 microversion: 2.1 time: 0.098868 Sep 01 17:36:35.121300 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 9/24] 10.222.0.100 () {58 vars in 1256 bytes} [Thu Sep 1 17:36:35 2022] GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3 => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:35.970351 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-de9cd1db-93a4-46b2-949c-13ab5c8bc61a tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] Calling method '.version_select at 0x7f354b40ec10>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:36.039208 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-de9cd1db-93a4-46b2-949c-13ab5c8bc61a tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] HTTP exception thrown: Volume 7ebeaeab-fa0a-4d24-8535-71ec68d4193a could not be found. Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-de9cd1db-93a4-46b2-949c-13ab5c8bc61a tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] Request method failure captured: Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a HTTP/1.1 Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2aMUPrx36o5VR64M9HgOaGwbwC2pHd8UxziyVxucGUaBIkFOej452zmrIiX4GM_EFrqMyxK8CdReMHp-MCulIuokFEMQkjQbA_1myP_qyK623mz5Fn9Hq_POXmq_OL19QJm43XWo9bs8Yy3Plvf5iRdmmd1KBTo3kL8SIYpaiyWS0 Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: f67baaa5ea164be2b89d3289fc9225fa Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-VolumesGetTestJSON-1770802792 Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:36:36.048273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:36:36.050081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f67baaa5ea164be2b89d3289fc9225fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/f67baaa5ea164be2b89d3289fc9225fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_f67baaa5ea164be2b89d3289fc9225fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f67baaa5ea164be2b89d3289fc9225fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:36:36.050081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-VolumesGetTestJSON-1770802792 Sep 01 17:36:36.050081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: f67baaa5ea164be2b89d3289fc9225fa Sep 01 17:36:36.050081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-VolumesGetTestJSON-1770802792 Sep 01 17:36:36.050081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-VolumesGetTestJSON-1770802792-project Sep 01 17:36:36.050081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:36:36.050081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:36:36.050081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: e7617a3afd7949daaa7763a784693ca2 Sep 01 17:36:36.050081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-VolumesGetTestJSON-1770802792-project Sep 01 17:36:36.050081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: Sep 01 17:36:36.050081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Volume 7ebeaeab-fa0a-4d24-8535-71ec68d4193a could not be found. Sep 01 17:36:36.050081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '7ebeaeab-fa0a-4d24-8535-71ec68d4193a'} Sep 01 17:36:36.050081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7ebeaeab-fa0a-4d24-8535-71ec68d4193a could not be found. (HTTP 404) (Request-ID: req-364a442f-af46-42fb-99ee-aac7ebf030cd) Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:36.050688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:36:36.051580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7ebeaeab-fa0a-4d24-8535-71ec68d4193a could not be found. Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 17:36:36.053859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7ebeaeab-fa0a-4d24-8535-71ec68d4193a could not be found. Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7ebeaeab-fa0a-4d24-8535-71ec68d4193a could not be found. Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-de9cd1db-93a4-46b2-949c-13ab5c8bc61a tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] Returning 404 to user: Volume 7ebeaeab-fa0a-4d24-8535-71ec68d4193a could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-de9cd1db-93a4-46b2-949c-13ab5c8bc61a tempest-VolumesGetTestJSON-1770802792 tempest-VolumesGetTestJSON-1770802792-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a" status: 404 len: 109 microversion: 2.1 time: 0.097254 Sep 01 17:36:36.061665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 16/25] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:36:35 2022] GET /compute/v2.1/os-volumes/7ebeaeab-fa0a-4d24-8535-71ec68d4193a => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:36:36.145944 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-69098d77-fdba-4e8d-bded-562d4f1ea0b4 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b4ba160>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:36.247805 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-69098d77-fdba-4e8d-bded-562d4f1ea0b4 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3" status: 200 len: 286 microversion: 2.1 time: 0.112486 Sep 01 17:36:36.249655 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 10/26] 10.222.0.100 () {58 vars in 1256 bytes} [Thu Sep 1 17:36:36 2022] GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3 => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:36.261373 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-86e86594-1300-454c-829f-180ba8ea19fc tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b49bb80>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:36.443468 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-86e86594-1300-454c-829f-180ba8ea19fc tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "DELETE /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3" status: 202 len: 0 microversion: 2.1 time: 0.186829 Sep 01 17:36:36.448204 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 17/27] 10.222.0.100 () {58 vars in 1259 bytes} [Thu Sep 1 17:36:36 2022] DELETE /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:36:36.456547 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-89e06c64-84d4-465b-a327-160e90354674 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b4a6ee0>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:36.675022 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-89e06c64-84d4-465b-a327-160e90354674 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3" status: 200 len: 285 microversion: 2.1 time: 0.225759 Sep 01 17:36:36.676185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 11/28] 10.222.0.100 () {58 vars in 1256 bytes} [Thu Sep 1 17:36:36 2022] GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3 => generated 285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:36:37.692695 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1c30c902-a8c5-44e5-b41e-55c56a32bd8b tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b40e700>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:37.742909 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-1c30c902-a8c5-44e5-b41e-55c56a32bd8b tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] HTTP exception thrown: Snapshot 97a4ddc0-6913-4eef-aa3f-39573ef2bea3 could not be found. Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1c30c902-a8c5-44e5-b41e-55c56a32bd8b tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Request method failure captured: Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3 HTTP/1.1 Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2bh9QgecoTygBIwGedY2bo-GlDDeJQtkGTyr4SlByfvEvb6CiU0KyjZuERUJuZdiVnFYSYbzlWbXiNzv8QXgtsR06TvTltdmxjlNmuSQMTkHuMrlYlQJ_oYRiZtBYjGfvLcCK0lLOKji2Mq3JERa7OGxS9Jkjkb_LUq9bJpVci-dA Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 19a5df264e224d8b901f524b41268ffc Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-32320867 Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:36:37.746850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:36:37.748014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/19a5df264e224d8b901f524b41268ffc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/19a5df264e224d8b901f524b41268ffc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_19a5df264e224d8b901f524b41268ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/19a5df264e224d8b901f524b41268ffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:36:37.748014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-VolumesSnapshotsTestJSON-32320867 Sep 01 17:36:37.748014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 19a5df264e224d8b901f524b41268ffc Sep 01 17:36:37.748014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-32320867 Sep 01 17:36:37.748014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-VolumesSnapshotsTestJSON-32320867-project Sep 01 17:36:37.748014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:36:37.748014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:36:37.748014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: f8ad7f0ec67542279d17b18e16da6bde Sep 01 17:36:37.748014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-VolumesSnapshotsTestJSON-32320867-project Sep 01 17:36:37.748014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: Sep 01 17:36:37.748014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Snapshot 97a4ddc0-6913-4eef-aa3f-39573ef2bea3 could not be found. Sep 01 17:36:37.748014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '97a4ddc0-6913-4eef-aa3f-39573ef2bea3'} Sep 01 17:36:37.748014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 97a4ddc0-6913-4eef-aa3f-39573ef2bea3 could not be found. (HTTP 404) (Request-ID: req-ffb6cfaa-7446-4298-8a18-de917c4e25c3) Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:37.748748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:36:37.749633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 97a4ddc0-6913-4eef-aa3f-39573ef2bea3 could not be found. Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 17:36:37.750665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 97a4ddc0-6913-4eef-aa3f-39573ef2bea3 could not be found. Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 97a4ddc0-6913-4eef-aa3f-39573ef2bea3 could not be found. Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1c30c902-a8c5-44e5-b41e-55c56a32bd8b tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Returning 404 to user: Snapshot 97a4ddc0-6913-4eef-aa3f-39573ef2bea3 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1c30c902-a8c5-44e5-b41e-55c56a32bd8b tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3" status: 404 len: 111 microversion: 2.1 time: 0.059711 Sep 01 17:36:37.751748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 18/29] 10.222.0.100 () {58 vars in 1256 bytes} [Thu Sep 1 17:36:37 2022] GET /compute/v2.1/os-snapshots/97a4ddc0-6913-4eef-aa3f-39573ef2bea3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:36:37.758048 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-baee32b3-24a2-4547-ade5-7202cd194d8f tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b4a6670>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:37.848491 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-baee32b3-24a2-4547-ade5-7202cd194d8f tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f" status: 202 len: 0 microversion: 2.1 time: 0.094413 Sep 01 17:36:37.849058 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 12/30] 10.222.0.100 () {58 vars in 1253 bytes} [Thu Sep 1 17:36:37 2022] DELETE /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:36:37.858260 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-be43b3d3-750e-46d4-a4b4-dc8317dc2b55 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b418af0>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:37.926328 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-be43b3d3-750e-46d4-a4b4-dc8317dc2b55 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f" status: 200 len: 344 microversion: 2.1 time: 0.072867 Sep 01 17:36:37.927332 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 19/31] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:36:37 2022] GET /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:38.954861 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-73c4c51a-fd76-4a1c-8010-683235378c1f tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b4ba3a0>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:39.055973 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-73c4c51a-fd76-4a1c-8010-683235378c1f tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f" status: 200 len: 344 microversion: 2.1 time: 0.118209 Sep 01 17:36:39.055973 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 13/32] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:36:38 2022] GET /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f => generated 344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:36:39.358658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-782852478", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:39.653675 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.network.neutron [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] validate_networks() for [('8e76aae4-b875-498c-b34d-2c5cc4479842', None, None, None, None, None)] {{(pid=127233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:36:40.070193 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-dbcc74d1-9126-48fb-8ea0-7647af93a199 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b4baa60>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:40.248546 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-dbcc74d1-9126-48fb-8ea0-7647af93a199 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] HTTP exception thrown: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-dbcc74d1-9126-48fb-8ea0-7647af93a199 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Request method failure captured: Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: GET /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f HTTP/1.1 Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO2bh9QgecoTygBIwGedY2bo-GlDDeJQtkGTyr4SlByfvEvb6CiU0KyjZuERUJuZdiVnFYSYbzlWbXiNzv8QXgtsR06TvTltdmxjlNmuSQMTkHuMrlYlQJ_oYRiZtBYjGfvLcCK0lLOKji2Mq3JERa7OGxS9Jkjkb_LUq9bJpVci-dA Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 19a5df264e224d8b901f524b41268ffc Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-32320867 Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:36:40.255795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:36:40.257149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/19a5df264e224d8b901f524b41268ffc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/19a5df264e224d8b901f524b41268ffc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_19a5df264e224d8b901f524b41268ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/19a5df264e224d8b901f524b41268ffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:36:40.257149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-VolumesSnapshotsTestJSON-32320867 Sep 01 17:36:40.257149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 19a5df264e224d8b901f524b41268ffc Sep 01 17:36:40.257149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-32320867 Sep 01 17:36:40.257149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-VolumesSnapshotsTestJSON-32320867-project Sep 01 17:36:40.257149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:36:40.257149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:36:40.257149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: f8ad7f0ec67542279d17b18e16da6bde Sep 01 17:36:40.257149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-VolumesSnapshotsTestJSON-32320867-project Sep 01 17:36:40.257149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: Sep 01 17:36:40.257149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.257149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '137a224e-fabf-4d27-a487-48b6087f032f'} Sep 01 17:36:40.257149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. (HTTP 404) (Request-ID: req-f66b1a1f-b5f0-4c50-baaa-d2b2b8e8798d) Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:40.257891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:36:40.259068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 17:36:40.262381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:36:40.264343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.264343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.264343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:40.264343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.264343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:40.264343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:40.264343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:40.264343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:36:40.264343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:36:40.264343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.264343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.267724 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-dbcc74d1-9126-48fb-8ea0-7647af93a199 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Returning 404 to user: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:36:40.271455 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-dbcc74d1-9126-48fb-8ea0-7647af93a199 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f" status: 404 len: 109 microversion: 2.1 time: 0.203325 Sep 01 17:36:40.291303 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 14/33] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:36:40 2022] GET /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f => generated 109 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 17:36:40.317498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-88d3c62f-17b8-41c9-9b9a-3b576db15a2b tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b4baee0>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:40.459132 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-88d3c62f-17b8-41c9-9b9a-3b576db15a2b tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] HTTP exception thrown: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-88d3c62f-17b8-41c9-9b9a-3b576db15a2b tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Request method failure captured: Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: DELETE /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f HTTP/1.1 Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO2bh9QgecoTygBIwGedY2bo-GlDDeJQtkGTyr4SlByfvEvb6CiU0KyjZuERUJuZdiVnFYSYbzlWbXiNzv8QXgtsR06TvTltdmxjlNmuSQMTkHuMrlYlQJ_oYRiZtBYjGfvLcCK0lLOKji2Mq3JERa7OGxS9Jkjkb_LUq9bJpVci-dA Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 19a5df264e224d8b901f524b41268ffc Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-32320867 Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:36:40.462828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:36:40.464481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/19a5df264e224d8b901f524b41268ffc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/19a5df264e224d8b901f524b41268ffc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_19a5df264e224d8b901f524b41268ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/19a5df264e224d8b901f524b41268ffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:36:40.464481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-VolumesSnapshotsTestJSON-32320867 Sep 01 17:36:40.464481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 19a5df264e224d8b901f524b41268ffc Sep 01 17:36:40.464481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-32320867 Sep 01 17:36:40.464481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-VolumesSnapshotsTestJSON-32320867-project Sep 01 17:36:40.464481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:36:40.464481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:36:40.464481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: f8ad7f0ec67542279d17b18e16da6bde Sep 01 17:36:40.464481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-VolumesSnapshotsTestJSON-32320867-project Sep 01 17:36:40.464481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: Sep 01 17:36:40.464481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.464481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '137a224e-fabf-4d27-a487-48b6087f032f'} Sep 01 17:36:40.464481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. (HTTP 404) (Request-ID: req-cb93598b-6e5e-4b3f-9116-74043d33df79) Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:40.465129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 17:36:40.466164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 17:36:40.467433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:36:40.468502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.468502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.468502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:40.468502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.468502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:40.468502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:40.468502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:40.468502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:36:40.468502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:36:40.468502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.468502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.468502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-88d3c62f-17b8-41c9-9b9a-3b576db15a2b tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Returning 404 to user: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:36:40.468502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-88d3c62f-17b8-41c9-9b9a-3b576db15a2b tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f" status: 404 len: 109 microversion: 2.1 time: 0.172467 Sep 01 17:36:40.469601 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 15/34] 10.222.0.100 () {58 vars in 1253 bytes} [Thu Sep 1 17:36:40 2022] DELETE /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f => generated 109 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:36:40.486828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-72a6c8d1-3815-40eb-b128-4d0474b45684 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Calling method '.version_select at 0x7f354b4ba940>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:40.602157 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-72a6c8d1-3815-40eb-b128-4d0474b45684 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] HTTP exception thrown: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-72a6c8d1-3815-40eb-b128-4d0474b45684 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Request method failure captured: Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: GET /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f HTTP/1.1 Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO2bh9QgecoTygBIwGedY2bo-GlDDeJQtkGTyr4SlByfvEvb6CiU0KyjZuERUJuZdiVnFYSYbzlWbXiNzv8QXgtsR06TvTltdmxjlNmuSQMTkHuMrlYlQJ_oYRiZtBYjGfvLcCK0lLOKji2Mq3JERa7OGxS9Jkjkb_LUq9bJpVci-dA Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 19a5df264e224d8b901f524b41268ffc Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-32320867 Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:36:40.604808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:36:40.606446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/19a5df264e224d8b901f524b41268ffc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/19a5df264e224d8b901f524b41268ffc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_19a5df264e224d8b901f524b41268ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/19a5df264e224d8b901f524b41268ffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:36:40.606446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-VolumesSnapshotsTestJSON-32320867 Sep 01 17:36:40.606446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 19a5df264e224d8b901f524b41268ffc Sep 01 17:36:40.606446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-32320867 Sep 01 17:36:40.606446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-VolumesSnapshotsTestJSON-32320867-project Sep 01 17:36:40.606446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:36:40.606446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:36:40.606446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: f8ad7f0ec67542279d17b18e16da6bde Sep 01 17:36:40.606446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-VolumesSnapshotsTestJSON-32320867-project Sep 01 17:36:40.606446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: Sep 01 17:36:40.606446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.606446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '137a224e-fabf-4d27-a487-48b6087f032f'} Sep 01 17:36:40.606446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. (HTTP 404) (Request-ID: req-c4cd1430-6fef-4114-ad3b-43d241a5ffab) Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:40.607221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:36:40.608271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 17:36:40.609136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:36:40.610039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.610039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.610039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:36:40.610039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.610039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:36:40.610039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:36:40.610039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:36:40.610039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:36:40.610039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:36:40.610039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. Sep 01 17:36:40.610039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:36:40.612668 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-72a6c8d1-3815-40eb-b128-4d0474b45684 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] Returning 404 to user: Volume 137a224e-fabf-4d27-a487-48b6087f032f could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:36:40.613793 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-72a6c8d1-3815-40eb-b128-4d0474b45684 tempest-VolumesSnapshotsTestJSON-32320867 tempest-VolumesSnapshotsTestJSON-32320867-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f" status: 404 len: 109 microversion: 2.1 time: 0.142861 Sep 01 17:36:40.619123 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 16/35] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:36:40 2022] GET /compute/v2.1/os-volumes/137a224e-fabf-4d27-a487-48b6087f032f => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:36:42.153599 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Flavor limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:36:42.154586 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Image limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:36:42.155465 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Flavor pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:36:42.156226 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Image pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:36:42.156992 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:36:42.215551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:42.216319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:42.217003 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:42.218116 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:42.218716 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:42.219279 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:42.358988 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Getting quotas for project b01df46ff9744c2f830459547d7e4dd6. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:36:42.387407 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Getting quotas for user 5647214c5b3f438eb3ef1ddc14153d9e and project b01df46ff9744c2f830459547d7e4dd6. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:36:42.433764 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Going to run 1 instances... {{(pid=127233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:36:42.448347 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:36:42.703503 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a32cb0c2-9ebb-4de0-bf39-0680c17c7a90 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 3.648018 Sep 01 17:36:42.705791 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 20/36] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:36:39 2022] POST /compute/v2.1/servers => generated 385 bytes in 3655 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:36:42.738953 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-47b8efe6-eab0-4de3-9bcd-48c1f4d24087 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:42.740594 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-47b8efe6-eab0-4de3-9bcd-48c1f4d24087 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:43.357267 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-47b8efe6-eab0-4de3-9bcd-48c1f4d24087 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:43.392930 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-47b8efe6-eab0-4de3-9bcd-48c1f4d24087 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1225 microversion: 2.1 time: 0.677500 Sep 01 17:36:43.410829 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 17/37] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:42 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1225 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:43.619088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-674104975", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:43.746895 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.network.neutron [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] validate_networks() for [('8e76aae4-b875-498c-b34d-2c5cc4479842', None, None, None, None, None)] {{(pid=127233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:36:45.100247 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Flavor limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:36:45.100786 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Image limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:36:45.101127 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Flavor pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:36:45.101520 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Image pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:36:45.101964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:36:45.122005 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:45.122795 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:45.123395 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:45.124519 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:45.130474 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:45.130932 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:45.208617 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Getting quotas for project b01df46ff9744c2f830459547d7e4dd6. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:36:45.220402 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Getting quotas for user 5647214c5b3f438eb3ef1ddc14153d9e and project b01df46ff9744c2f830459547d7e4dd6. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:36:45.252089 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Going to run 1 instances... {{(pid=127233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:36:45.254714 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:36:45.356031 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-c675cf26-3916-407f-8572-45ec0a89b192 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.743166 Sep 01 17:36:45.357287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 21/38] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:36:43 2022] POST /compute/v2.1/servers => generated 385 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:36:45.377600 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-be0d9edc-c2fc-48b5-a618-7e5e5dfed309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:45.379116 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-be0d9edc-c2fc-48b5-a618-7e5e5dfed309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:45.538328 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-684770665", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "networks": [{"uuid": "201448a9-9306-4b27-81e0-ff49c43a14f7"}]}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:45.593497 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-be0d9edc-c2fc-48b5-a618-7e5e5dfed309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:45.675934 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-be0d9edc-c2fc-48b5-a618-7e5e5dfed309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1225 microversion: 2.1 time: 0.302647 Sep 01 17:36:45.688892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 22/39] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:45 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1225 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:45.858558 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.network.neutron [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] validate_networks() for [('201448a9-9306-4b27-81e0-ff49c43a14f7', None, None, None, None, None)] {{(pid=127232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:36:46.958215 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d1cae118-a8de-4fdd-8c0b-b515175ec2c5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Action: 'create', calling method: .version_select at 0x7f354ab29f70>, body: {"keypair": {"name": "tempest-keypair-2014964786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfynbHkxlnL1r3HhYSSoR2lI9m9cMWaGyBe5DJZRtLzziJZ75H0GX5agmWbd30tR/KWATuPVYFMeCIYzlKLXMFTL9P1HSmIJPLeeYGOHJzUi3b/a/6FMKg32kHjuPxpzQ=="}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:47.049441 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-d1cae118-a8de-4fdd-8c0b-b515175ec2c5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Getting quotas for project e11b8d4a14a9460eb4ce9967f86e4757. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:36:47.070533 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-d1cae118-a8de-4fdd-8c0b-b515175ec2c5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Getting quotas for user bcc538bc852f404699d91d17023ae620 and project e11b8d4a14a9460eb4ce9967f86e4757. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:36:47.199018 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d1cae118-a8de-4fdd-8c0b-b515175ec2c5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.846345 Sep 01 17:36:47.206147 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 23/40] 10.222.0.100 () {62 vars in 1205 bytes} [Thu Sep 1 17:36:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 861 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 17:36:47.211003 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e667f8ab-f382-41b9-ad42-36f0edebb9d0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:47.211682 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e667f8ab-f382-41b9-ad42-36f0edebb9d0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:47.926857 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e667f8ab-f382-41b9-ad42-36f0edebb9d0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:47.940961 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e667f8ab-f382-41b9-ad42-36f0edebb9d0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1225 microversion: 2.1 time: 0.733574 Sep 01 17:36:47.944007 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 24/41] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:47 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1225 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:48.963627 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6b85da8d-d933-4837-bb77-dd53bf96f736 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:48.965039 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6b85da8d-d933-4837-bb77-dd53bf96f736 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:48.978020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b85da8d-d933-4837-bb77-dd53bf96f736 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:48.980127 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b85da8d-d933-4837-bb77-dd53bf96f736 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:48.981267 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b85da8d-d933-4837-bb77-dd53bf96f736 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:48.984463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b85da8d-d933-4837-bb77-dd53bf96f736 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:48.984928 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b85da8d-d933-4837-bb77-dd53bf96f736 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:48.985352 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b85da8d-d933-4837-bb77-dd53bf96f736 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:50.887120 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-6b85da8d-d933-4837-bb77-dd53bf96f736 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:50.917817 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-6b85da8d-d933-4837-bb77-dd53bf96f736 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1285 microversion: 2.1 time: 1.958387 Sep 01 17:36:50.926897 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 25/42] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:48 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1285 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:36:51.143302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Flavor limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:36:51.143940 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Image limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:36:51.144458 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Flavor pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:36:51.144862 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Image pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:36:51.145266 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:36:51.207562 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:51.214382 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:51.218427 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:51.222779 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:51.228659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:51.232410 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:51.362775 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Getting quotas for project df3925a7fb6c4d099c4f160d42870a3b. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:36:51.392099 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Getting quotas for user bcea72e4fc77431a96e7acf9d68eb083 and project df3925a7fb6c4d099c4f160d42870a3b. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:36:51.453834 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Going to run 1 instances... {{(pid=127232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:36:51.461694 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:36:51.692138 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a9670307-26e5-4075-b90d-12d712c22bc9 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 7.115250 Sep 01 17:36:51.693235 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 18/43] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:36:44 2022] POST /compute/v2.1/servers => generated 382 bytes in 7117 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:36:51.706375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-40a43815-e4c1-4204-9432-0b94a835b10a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:51.707401 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-40a43815-e4c1-4204-9432-0b94a835b10a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:51.953726 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-48ac81f4-8acf-4893-933f-304296d4144f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:51.954730 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-48ac81f4-8acf-4893-933f-304296d4144f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:51.998642 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-48ac81f4-8acf-4893-933f-304296d4144f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:51.999649 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-48ac81f4-8acf-4893-933f-304296d4144f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:52.000302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-48ac81f4-8acf-4893-933f-304296d4144f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:52.001376 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-48ac81f4-8acf-4893-933f-304296d4144f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:52.002697 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-48ac81f4-8acf-4893-933f-304296d4144f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:52.016822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-48ac81f4-8acf-4893-933f-304296d4144f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:52.019708 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-40a43815-e4c1-4204-9432-0b94a835b10a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:52.036456 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-40a43815-e4c1-4204-9432-0b94a835b10a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1218 microversion: 2.1 time: 0.333149 Sep 01 17:36:52.043718 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 26/44] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:51 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1218 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:52.725555 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-48ac81f4-8acf-4893-933f-304296d4144f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:52.787490 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-48ac81f4-8acf-4893-933f-304296d4144f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1283 microversion: 2.1 time: 0.838222 Sep 01 17:36:52.819915 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 19/45] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:51 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1283 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:53.064908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-daf8f9ac-4bb4-48ce-a56b-8b508fa43ee4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:53.065630 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-daf8f9ac-4bb4-48ce-a56b-8b508fa43ee4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:53.549668 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-daf8f9ac-4bb4-48ce-a56b-8b508fa43ee4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:53.558237 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-daf8f9ac-4bb4-48ce-a56b-8b508fa43ee4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1218 microversion: 2.1 time: 0.497703 Sep 01 17:36:53.565102 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 27/46] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:53 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1218 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:53.827053 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b23f8c52-1cee-4fe2-a5c6-46c0bf8e645b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:53.828994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b23f8c52-1cee-4fe2-a5c6-46c0bf8e645b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:53.863346 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b23f8c52-1cee-4fe2-a5c6-46c0bf8e645b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:53.864148 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b23f8c52-1cee-4fe2-a5c6-46c0bf8e645b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:53.864813 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b23f8c52-1cee-4fe2-a5c6-46c0bf8e645b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:53.867757 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b23f8c52-1cee-4fe2-a5c6-46c0bf8e645b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:53.871275 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b23f8c52-1cee-4fe2-a5c6-46c0bf8e645b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:53.872594 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b23f8c52-1cee-4fe2-a5c6-46c0bf8e645b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:54.585956 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d0491171-9829-44ae-aa25-c121732398cb tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:54.586568 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d0491171-9829-44ae-aa25-c121732398cb tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:54.596928 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d0491171-9829-44ae-aa25-c121732398cb tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:54.607697 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d0491171-9829-44ae-aa25-c121732398cb tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:54.608680 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d0491171-9829-44ae-aa25-c121732398cb tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:54.609641 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d0491171-9829-44ae-aa25-c121732398cb tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:54.610267 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d0491171-9829-44ae-aa25-c121732398cb tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:54.610854 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d0491171-9829-44ae-aa25-c121732398cb tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:54.663114 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b23f8c52-1cee-4fe2-a5c6-46c0bf8e645b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:54.671296 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b23f8c52-1cee-4fe2-a5c6-46c0bf8e645b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1283 microversion: 2.1 time: 0.849392 Sep 01 17:36:54.679425 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 20/47] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:53 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1283 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:55.169945 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=4 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:55.280388 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d0491171-9829-44ae-aa25-c121732398cb tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:55.294386 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d0491171-9829-44ae-aa25-c121732398cb tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1270 microversion: 2.1 time: 0.711790 Sep 01 17:36:55.328676 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 28/48] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:54 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1270 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:55.700477 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-22a524cf-da43-4901-bc1f-284f7fb2e222 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:55.702978 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-22a524cf-da43-4901-bc1f-284f7fb2e222 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:55.716691 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-22a524cf-da43-4901-bc1f-284f7fb2e222 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:55.721546 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-22a524cf-da43-4901-bc1f-284f7fb2e222 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:55.722233 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-22a524cf-da43-4901-bc1f-284f7fb2e222 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:55.725471 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-22a524cf-da43-4901-bc1f-284f7fb2e222 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:55.726184 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-22a524cf-da43-4901-bc1f-284f7fb2e222 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:55.726943 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-22a524cf-da43-4901-bc1f-284f7fb2e222 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:56.295420 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-22a524cf-da43-4901-bc1f-284f7fb2e222 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:56.321229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5805ef9c-35dd-4fcc-86ee-0de485853f0d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:56.322120 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-22a524cf-da43-4901-bc1f-284f7fb2e222 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.616230 Sep 01 17:36:56.322916 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 21/49] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:55 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:56.323160 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5805ef9c-35dd-4fcc-86ee-0de485853f0d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:56.342509 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5805ef9c-35dd-4fcc-86ee-0de485853f0d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:56.343020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5805ef9c-35dd-4fcc-86ee-0de485853f0d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:56.343465 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5805ef9c-35dd-4fcc-86ee-0de485853f0d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:56.344175 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5805ef9c-35dd-4fcc-86ee-0de485853f0d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:56.344636 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5805ef9c-35dd-4fcc-86ee-0de485853f0d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:56.345851 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-750254226", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c432092d-3c48-4974-8235-c648e44e8e44"}], "security_groups": [{"name": "tempest-securitygroup--1437375671"}], "key_name": "tempest-keypair-2014964786", "user_data": "}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:56.358210 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5805ef9c-35dd-4fcc-86ee-0de485853f0d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:56.911659 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5805ef9c-35dd-4fcc-86ee-0de485853f0d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:56.923731 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5805ef9c-35dd-4fcc-86ee-0de485853f0d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1276 microversion: 2.1 time: 0.611269 Sep 01 17:36:56.926480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 29/50] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:56 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1276 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:57.344143 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0e81ca5c-e440-4ca5-a139-2dfaf52b676d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:57.345966 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0e81ca5c-e440-4ca5-a139-2dfaf52b676d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:57.357826 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e81ca5c-e440-4ca5-a139-2dfaf52b676d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:57.359908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e81ca5c-e440-4ca5-a139-2dfaf52b676d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:57.360703 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e81ca5c-e440-4ca5-a139-2dfaf52b676d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:57.361932 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e81ca5c-e440-4ca5-a139-2dfaf52b676d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:57.362801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e81ca5c-e440-4ca5-a139-2dfaf52b676d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:57.363563 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e81ca5c-e440-4ca5-a139-2dfaf52b676d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:57.440339 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.network.neutron [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] validate_networks() for [('c432092d-3c48-4974-8235-c648e44e8e44', None, None, None, None, None)] {{(pid=127232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:36:58.959191 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0e81ca5c-e440-4ca5-a139-2dfaf52b676d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:58.973112 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0e81ca5c-e440-4ca5-a139-2dfaf52b676d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 1.633913 Sep 01 17:36:58.976197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 30/51] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:57 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:36:59.406797 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-e6f2df40-1def-476c-8012-8f2562cabe06 req-285eb556-3437-42ce-8d48-f67a101b5daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f637e8e-d6ed-4516-b57d-48174aa65926", "tag": "87b4da6d-8b68-433c-ae8f-43c4c9fda0c1"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:59.466911 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-e6f2df40-1def-476c-8012-8f2562cabe06 req-285eb556-3437-42ce-8d48-f67a101b5daa service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:59.467400 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-e6f2df40-1def-476c-8012-8f2562cabe06 req-285eb556-3437-42ce-8d48-f67a101b5daa service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:59.467836 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-e6f2df40-1def-476c-8012-8f2562cabe06 req-285eb556-3437-42ce-8d48-f67a101b5daa service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:59.565937 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-e6f2df40-1def-476c-8012-8f2562cabe06 req-285eb556-3437-42ce-8d48-f67a101b5daa service nova] Creating event network-changed:87b4da6d-8b68-433c-ae8f-43c4c9fda0c1 for instance 0f637e8e-d6ed-4516-b57d-48174aa65926 on hv-cinder-83976 Sep 01 17:36:59.566464 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-e6f2df40-1def-476c-8012-8f2562cabe06 req-285eb556-3437-42ce-8d48-f67a101b5daa service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127233) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 17:36:59.571272 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-e6f2df40-1def-476c-8012-8f2562cabe06 req-285eb556-3437-42ce-8d48-f67a101b5daa service nova] Acquired lock "compute-rpcapi-router" {{(pid=127233) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 17:36:59.574828 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3eebc49f-7e74-40b2-bd0a-f7d18fc426bd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:59.575491 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3eebc49f-7e74-40b2-bd0a-f7d18fc426bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:59.576071 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3eebc49f-7e74-40b2-bd0a-f7d18fc426bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:59.594054 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3eebc49f-7e74-40b2-bd0a-f7d18fc426bd None None] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:59.599304 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3eebc49f-7e74-40b2-bd0a-f7d18fc426bd None None] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:59.600007 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3eebc49f-7e74-40b2-bd0a-f7d18fc426bd None None] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:59.637542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.compute.rpcapi [None req-3eebc49f-7e74-40b2-bd0a-f7d18fc426bd None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 17:36:59.640141 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3eebc49f-7e74-40b2-bd0a-f7d18fc426bd None None] Releasing lock "compute-rpcapi-router" {{(pid=127233) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 17:36:59.724931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3eebc49f-7e74-40b2-bd0a-f7d18fc426bd None None] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.712426 Sep 01 17:36:59.725868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 31/52] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:59.763345 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-fbdda777-5b85-47a7-b6e7-1ffe75346d74 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:59.764094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-fbdda777-5b85-47a7-b6e7-1ffe75346d74 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:59.788540 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fbdda777-5b85-47a7-b6e7-1ffe75346d74 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:59.789039 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fbdda777-5b85-47a7-b6e7-1ffe75346d74 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:59.789477 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fbdda777-5b85-47a7-b6e7-1ffe75346d74 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:59.799772 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fbdda777-5b85-47a7-b6e7-1ffe75346d74 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:59.800269 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fbdda777-5b85-47a7-b6e7-1ffe75346d74 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:59.800710 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fbdda777-5b85-47a7-b6e7-1ffe75346d74 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:00.113268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-fbdda777-5b85-47a7-b6e7-1ffe75346d74 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:00.122878 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-fbdda777-5b85-47a7-b6e7-1ffe75346d74 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.394555 Sep 01 17:37:00.126292 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 32/53] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:59 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:00.137788 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-aff560e7-06eb-46a9-9cfa-995b27a83cb6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:00.142478 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-aff560e7-06eb-46a9-9cfa-995b27a83cb6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:00.153161 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-aff560e7-06eb-46a9-9cfa-995b27a83cb6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:00.158330 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-aff560e7-06eb-46a9-9cfa-995b27a83cb6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:00.159067 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-aff560e7-06eb-46a9-9cfa-995b27a83cb6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:00.160013 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-aff560e7-06eb-46a9-9cfa-995b27a83cb6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:00.160618 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-aff560e7-06eb-46a9-9cfa-995b27a83cb6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:00.161499 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-aff560e7-06eb-46a9-9cfa-995b27a83cb6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:00.197371 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Flavor limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:37:00.198667 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Image limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:37:00.199353 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Flavor pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:37:00.199841 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Image pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:37:00.200329 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:37:00.224120 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:00.226449 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:00.231994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:00.232812 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:00.233934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:00.234671 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:00.307502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Getting quotas for project e11b8d4a14a9460eb4ce9967f86e4757. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:37:00.318651 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Getting quotas for user bcc538bc852f404699d91d17023ae620 and project e11b8d4a14a9460eb4ce9967f86e4757. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:37:00.365822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Going to run 1 instances... {{(pid=127232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:37:00.379898 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:37:00.532561 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e188ee4e-ad65-400a-9519-7640ca2ab7fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 4.191792 Sep 01 17:37:00.542834 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 22/54] 10.222.0.100 () {62 vars in 1193 bytes} [Thu Sep 1 17:36:56 2022] POST /compute/v2.1/servers => generated 404 bytes in 4203 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 01 17:37:00.556488 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2e1f435f-5a8b-408f-be8f-20a4678fd6a7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:00.557772 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2e1f435f-5a8b-408f-be8f-20a4678fd6a7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:00.737039 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-aff560e7-06eb-46a9-9cfa-995b27a83cb6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:00.746092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-aff560e7-06eb-46a9-9cfa-995b27a83cb6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.617833 Sep 01 17:37:00.746679 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 33/55] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:00 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:00.952353 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2e1f435f-5a8b-408f-be8f-20a4678fd6a7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:00.972414 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2e1f435f-5a8b-408f-be8f-20a4678fd6a7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:00.975698 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2e1f435f-5a8b-408f-be8f-20a4678fd6a7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:00.983104 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-b5ef8d4c-63d0-4139-a38f-4c939242720c req-31cb0497-c3e3-46de-8b82-c3a97be6977b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2905128c-3c89-498f-92c1-7c4bce87f75c", "tag": "f202a908-6c12-487f-a321-2dd4650a0faf"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:00.987523 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2e1f435f-5a8b-408f-be8f-20a4678fd6a7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1285 microversion: 2.20 time: 0.442492 Sep 01 17:37:00.990573 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 23/56] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:00 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1285 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:01.013489 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-b5ef8d4c-63d0-4139-a38f-4c939242720c req-31cb0497-c3e3-46de-8b82-c3a97be6977b service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:01.019763 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-b5ef8d4c-63d0-4139-a38f-4c939242720c req-31cb0497-c3e3-46de-8b82-c3a97be6977b service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:01.020206 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-b5ef8d4c-63d0-4139-a38f-4c939242720c req-31cb0497-c3e3-46de-8b82-c3a97be6977b service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:01.049080 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-b5ef8d4c-63d0-4139-a38f-4c939242720c req-31cb0497-c3e3-46de-8b82-c3a97be6977b service nova] Creating event network-changed:f202a908-6c12-487f-a321-2dd4650a0faf for instance 2905128c-3c89-498f-92c1-7c4bce87f75c on hv-cinder-83976 Sep 01 17:37:01.071796 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-b5ef8d4c-63d0-4139-a38f-4c939242720c req-31cb0497-c3e3-46de-8b82-c3a97be6977b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285061 Sep 01 17:37:01.077200 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 34/57] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:37:01.163968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bba755ac-0e4f-4da5-8220-5a93330f995c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:01.167838 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bba755ac-0e4f-4da5-8220-5a93330f995c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:01.191384 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bba755ac-0e4f-4da5-8220-5a93330f995c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:01.194420 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bba755ac-0e4f-4da5-8220-5a93330f995c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:01.196258 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bba755ac-0e4f-4da5-8220-5a93330f995c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:01.197751 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bba755ac-0e4f-4da5-8220-5a93330f995c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:01.206368 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bba755ac-0e4f-4da5-8220-5a93330f995c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:01.207361 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bba755ac-0e4f-4da5-8220-5a93330f995c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:01.770603 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4f0e3d8c-d3f5-4436-b5f1-a33c0d5f9749 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:01.771412 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4f0e3d8c-d3f5-4436-b5f1-a33c0d5f9749 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:01.787663 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4f0e3d8c-d3f5-4436-b5f1-a33c0d5f9749 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:01.792290 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4f0e3d8c-d3f5-4436-b5f1-a33c0d5f9749 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:01.795761 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4f0e3d8c-d3f5-4436-b5f1-a33c0d5f9749 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:01.798832 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4f0e3d8c-d3f5-4436-b5f1-a33c0d5f9749 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:01.807610 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4f0e3d8c-d3f5-4436-b5f1-a33c0d5f9749 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:01.815918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4f0e3d8c-d3f5-4436-b5f1-a33c0d5f9749 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:02.124432 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bba755ac-0e4f-4da5-8220-5a93330f995c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:02.144081 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bba755ac-0e4f-4da5-8220-5a93330f995c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.995977 Sep 01 17:37:02.160030 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 24/58] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:01 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:02.177392 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-37b57ba0-bf35-4b44-8329-57618ffafa66 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:02.179425 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-37b57ba0-bf35-4b44-8329-57618ffafa66 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:02.199305 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-37b57ba0-bf35-4b44-8329-57618ffafa66 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:02.202479 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-37b57ba0-bf35-4b44-8329-57618ffafa66 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:02.205222 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-37b57ba0-bf35-4b44-8329-57618ffafa66 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:02.208664 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-37b57ba0-bf35-4b44-8329-57618ffafa66 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:02.210286 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-37b57ba0-bf35-4b44-8329-57618ffafa66 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:02.215000 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-37b57ba0-bf35-4b44-8329-57618ffafa66 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:02.450175 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-37b57ba0-bf35-4b44-8329-57618ffafa66 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:02.459131 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-37b57ba0-bf35-4b44-8329-57618ffafa66 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:02.460856 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-37b57ba0-bf35-4b44-8329-57618ffafa66 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:02.462191 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-37b57ba0-bf35-4b44-8329-57618ffafa66 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.298510 Sep 01 17:37:02.463529 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 25/59] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:02 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:02.515293 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4f0e3d8c-d3f5-4436-b5f1-a33c0d5f9749 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:02.527202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4f0e3d8c-d3f5-4436-b5f1-a33c0d5f9749 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.759618 Sep 01 17:37:02.528164 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 35/60] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:01 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:03.167085 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4470013c-3dbb-4d87-9299-1938960d919f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:03.167704 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4470013c-3dbb-4d87-9299-1938960d919f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:03.173877 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4470013c-3dbb-4d87-9299-1938960d919f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:03.175135 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4470013c-3dbb-4d87-9299-1938960d919f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:03.175759 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4470013c-3dbb-4d87-9299-1938960d919f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:03.176652 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4470013c-3dbb-4d87-9299-1938960d919f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:03.177536 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4470013c-3dbb-4d87-9299-1938960d919f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:03.178648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4470013c-3dbb-4d87-9299-1938960d919f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:03.361327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4470013c-3dbb-4d87-9299-1938960d919f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:03.370502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4470013c-3dbb-4d87-9299-1938960d919f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.207880 Sep 01 17:37:03.371472 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 26/61] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:03 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:03.487444 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7f178bf8-3370-4a66-b4fe-2396a010a756 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:03.488310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7f178bf8-3370-4a66-b4fe-2396a010a756 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:03.494718 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f178bf8-3370-4a66-b4fe-2396a010a756 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:03.495856 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f178bf8-3370-4a66-b4fe-2396a010a756 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:03.496540 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f178bf8-3370-4a66-b4fe-2396a010a756 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:03.497460 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f178bf8-3370-4a66-b4fe-2396a010a756 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:03.498147 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f178bf8-3370-4a66-b4fe-2396a010a756 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:03.498831 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f178bf8-3370-4a66-b4fe-2396a010a756 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:03.551186 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3ddc850d-60a6-4edd-a099-802ef3a37ac9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:03.551812 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3ddc850d-60a6-4edd-a099-802ef3a37ac9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:03.558472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=24 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:03.566324 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3ddc850d-60a6-4edd-a099-802ef3a37ac9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:03.567087 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3ddc850d-60a6-4edd-a099-802ef3a37ac9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:03.567744 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3ddc850d-60a6-4edd-a099-802ef3a37ac9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:03.568688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3ddc850d-60a6-4edd-a099-802ef3a37ac9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:03.569340 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3ddc850d-60a6-4edd-a099-802ef3a37ac9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:03.570907 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3ddc850d-60a6-4edd-a099-802ef3a37ac9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:03.588048 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7f178bf8-3370-4a66-b4fe-2396a010a756 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:03.608953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7f178bf8-3370-4a66-b4fe-2396a010a756 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:03.623565 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7f178bf8-3370-4a66-b4fe-2396a010a756 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:03.625943 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7f178bf8-3370-4a66-b4fe-2396a010a756 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.142463 Sep 01 17:37:03.639284 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 36/62] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:03 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:37:03.764255 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-0ea98201-e3ad-4a92-b9d6-cdc9fd250244 req-17c4a69f-0db8-45dc-82d7-3953f77881e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab8419fc-b28b-4b08-9d93-85239477e211", "tag": "7d68e73f-e366-4e0c-baba-4fcb61d7ddcd"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:03.782610 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-0ea98201-e3ad-4a92-b9d6-cdc9fd250244 req-17c4a69f-0db8-45dc-82d7-3953f77881e7 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:03.787342 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-0ea98201-e3ad-4a92-b9d6-cdc9fd250244 req-17c4a69f-0db8-45dc-82d7-3953f77881e7 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:03.788666 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-0ea98201-e3ad-4a92-b9d6-cdc9fd250244 req-17c4a69f-0db8-45dc-82d7-3953f77881e7 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:03.804342 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-0ea98201-e3ad-4a92-b9d6-cdc9fd250244 req-17c4a69f-0db8-45dc-82d7-3953f77881e7 service nova] Creating event network-changed:7d68e73f-e366-4e0c-baba-4fcb61d7ddcd for instance ab8419fc-b28b-4b08-9d93-85239477e211 on hv-cinder-83976 Sep 01 17:37:03.809223 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3ddc850d-60a6-4edd-a099-802ef3a37ac9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:03.813179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-0ea98201-e3ad-4a92-b9d6-cdc9fd250244 req-17c4a69f-0db8-45dc-82d7-3953f77881e7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053833 Sep 01 17:37:03.814571 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 37/63] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:37:03.820856 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-3ddc850d-60a6-4edd-a099-802ef3a37ac9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.275804 Sep 01 17:37:03.821533 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 27/64] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:03 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:04.393063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-962851c0-016b-4eb5-b2ae-464f8399ff2a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:04.393786 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-962851c0-016b-4eb5-b2ae-464f8399ff2a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:04.400805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-962851c0-016b-4eb5-b2ae-464f8399ff2a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:04.401512 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-962851c0-016b-4eb5-b2ae-464f8399ff2a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:04.402132 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-962851c0-016b-4eb5-b2ae-464f8399ff2a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:04.402974 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-962851c0-016b-4eb5-b2ae-464f8399ff2a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:04.403593 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-962851c0-016b-4eb5-b2ae-464f8399ff2a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:04.404151 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-962851c0-016b-4eb5-b2ae-464f8399ff2a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:04.576265 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-962851c0-016b-4eb5-b2ae-464f8399ff2a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:04.584886 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-962851c0-016b-4eb5-b2ae-464f8399ff2a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.195923 Sep 01 17:37:04.585703 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 38/65] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:04 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:04.656999 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-31560869-507c-4125-bc22-7cddb84a70d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:04.656999 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-31560869-507c-4125-bc22-7cddb84a70d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:04.662879 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31560869-507c-4125-bc22-7cddb84a70d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:04.663479 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31560869-507c-4125-bc22-7cddb84a70d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:04.664107 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31560869-507c-4125-bc22-7cddb84a70d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:04.665011 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31560869-507c-4125-bc22-7cddb84a70d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:04.665557 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31560869-507c-4125-bc22-7cddb84a70d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:04.666861 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31560869-507c-4125-bc22-7cddb84a70d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:04.734878 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-31560869-507c-4125-bc22-7cddb84a70d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:04.745596 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-31560869-507c-4125-bc22-7cddb84a70d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:04.746936 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-31560869-507c-4125-bc22-7cddb84a70d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:04.748129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-31560869-507c-4125-bc22-7cddb84a70d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.098187 Sep 01 17:37:04.760126 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 28/66] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:04 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:04.849171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-98adce07-ff5f-4cf9-b700-8850082f90fa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:04.850115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-98adce07-ff5f-4cf9-b700-8850082f90fa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:04.863173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-98adce07-ff5f-4cf9-b700-8850082f90fa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:04.863675 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-98adce07-ff5f-4cf9-b700-8850082f90fa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:04.864112 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-98adce07-ff5f-4cf9-b700-8850082f90fa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:04.864825 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-98adce07-ff5f-4cf9-b700-8850082f90fa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:04.870243 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-98adce07-ff5f-4cf9-b700-8850082f90fa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:04.870387 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-98adce07-ff5f-4cf9-b700-8850082f90fa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:05.154012 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-98adce07-ff5f-4cf9-b700-8850082f90fa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:05.170786 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-98adce07-ff5f-4cf9-b700-8850082f90fa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.325787 Sep 01 17:37:05.174215 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 39/67] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:04 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:05.608527 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5d807469-3a88-4210-a915-6e6cbfbef027 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:05.609273 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5d807469-3a88-4210-a915-6e6cbfbef027 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:05.615821 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5d807469-3a88-4210-a915-6e6cbfbef027 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:05.616299 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5d807469-3a88-4210-a915-6e6cbfbef027 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:05.616916 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5d807469-3a88-4210-a915-6e6cbfbef027 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:05.618109 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5d807469-3a88-4210-a915-6e6cbfbef027 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:05.618560 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5d807469-3a88-4210-a915-6e6cbfbef027 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:05.619012 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5d807469-3a88-4210-a915-6e6cbfbef027 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:05.792853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-65860de6-5d6c-4838-bc57-e15b8e5e0a9b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:05.797608 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-65860de6-5d6c-4838-bc57-e15b8e5e0a9b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:05.816106 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-65860de6-5d6c-4838-bc57-e15b8e5e0a9b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:05.817397 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-65860de6-5d6c-4838-bc57-e15b8e5e0a9b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:05.818119 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-65860de6-5d6c-4838-bc57-e15b8e5e0a9b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:05.819355 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-65860de6-5d6c-4838-bc57-e15b8e5e0a9b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:05.820113 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-65860de6-5d6c-4838-bc57-e15b8e5e0a9b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:05.821394 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-65860de6-5d6c-4838-bc57-e15b8e5e0a9b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:05.913349 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-65860de6-5d6c-4838-bc57-e15b8e5e0a9b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:05.925806 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-65860de6-5d6c-4838-bc57-e15b8e5e0a9b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:05.927618 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-65860de6-5d6c-4838-bc57-e15b8e5e0a9b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:05.929237 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-65860de6-5d6c-4838-bc57-e15b8e5e0a9b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.148170 Sep 01 17:37:05.930272 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 40/68] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:05 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:05.975250 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5d807469-3a88-4210-a915-6e6cbfbef027 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:05.984011 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5d807469-3a88-4210-a915-6e6cbfbef027 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.381456 Sep 01 17:37:05.984907 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 29/69] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:05 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:06.196765 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-241af95c-c907-4662-8380-3752174da15d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:06.198439 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-241af95c-c907-4662-8380-3752174da15d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:06.205697 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-241af95c-c907-4662-8380-3752174da15d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:06.206434 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-241af95c-c907-4662-8380-3752174da15d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:06.206868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-241af95c-c907-4662-8380-3752174da15d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:06.207737 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-241af95c-c907-4662-8380-3752174da15d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:06.208358 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-241af95c-c907-4662-8380-3752174da15d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:06.208775 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-241af95c-c907-4662-8380-3752174da15d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:06.368752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-241af95c-c907-4662-8380-3752174da15d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:06.378958 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-241af95c-c907-4662-8380-3752174da15d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.186448 Sep 01 17:37:06.379702 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 41/70] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:06 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:06.953711 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-95c85e04-c594-45b4-bd48-79f0d181c03c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:06.954334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-95c85e04-c594-45b4-bd48-79f0d181c03c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:06.969739 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-95c85e04-c594-45b4-bd48-79f0d181c03c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:06.970312 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-95c85e04-c594-45b4-bd48-79f0d181c03c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:06.970755 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-95c85e04-c594-45b4-bd48-79f0d181c03c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:06.971474 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-95c85e04-c594-45b4-bd48-79f0d181c03c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:06.972097 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-95c85e04-c594-45b4-bd48-79f0d181c03c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:06.972641 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-95c85e04-c594-45b4-bd48-79f0d181c03c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:07.005992 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-521bc128-eafd-4325-8a7f-acaee8b17370 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:07.007311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-521bc128-eafd-4325-8a7f-acaee8b17370 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:07.014961 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-521bc128-eafd-4325-8a7f-acaee8b17370 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:07.015813 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-521bc128-eafd-4325-8a7f-acaee8b17370 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:07.016685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-521bc128-eafd-4325-8a7f-acaee8b17370 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:07.017721 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-521bc128-eafd-4325-8a7f-acaee8b17370 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:07.018484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-521bc128-eafd-4325-8a7f-acaee8b17370 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:07.018917 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-521bc128-eafd-4325-8a7f-acaee8b17370 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:07.053320 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-95c85e04-c594-45b4-bd48-79f0d181c03c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:07.069462 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-95c85e04-c594-45b4-bd48-79f0d181c03c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:07.072768 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-95c85e04-c594-45b4-bd48-79f0d181c03c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:07.074197 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-95c85e04-c594-45b4-bd48-79f0d181c03c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.124765 Sep 01 17:37:07.092148 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 30/71] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:06 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:07.212470 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-521bc128-eafd-4325-8a7f-acaee8b17370 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:07.224127 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-521bc128-eafd-4325-8a7f-acaee8b17370 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.221943 Sep 01 17:37:07.238096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 42/72] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:07 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:07.400149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-244e437c-7c66-498c-a033-a924df9fe593 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:07.404622 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-244e437c-7c66-498c-a033-a924df9fe593 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:07.411006 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-244e437c-7c66-498c-a033-a924df9fe593 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:07.412065 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-244e437c-7c66-498c-a033-a924df9fe593 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:07.412818 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-244e437c-7c66-498c-a033-a924df9fe593 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:07.413906 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-244e437c-7c66-498c-a033-a924df9fe593 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:07.414657 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-244e437c-7c66-498c-a033-a924df9fe593 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:07.415367 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-244e437c-7c66-498c-a033-a924df9fe593 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:07.606308 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-244e437c-7c66-498c-a033-a924df9fe593 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:07.622358 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-244e437c-7c66-498c-a033-a924df9fe593 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.225099 Sep 01 17:37:07.623396 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 31/73] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:07 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:08.098574 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c01ffa3e-fd38-4780-8dbc-66566b538b6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:08.099361 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c01ffa3e-fd38-4780-8dbc-66566b538b6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:08.109520 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:08.111109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c01ffa3e-fd38-4780-8dbc-66566b538b6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:08.111610 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c01ffa3e-fd38-4780-8dbc-66566b538b6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:08.114066 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c01ffa3e-fd38-4780-8dbc-66566b538b6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:08.114840 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c01ffa3e-fd38-4780-8dbc-66566b538b6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:08.115304 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c01ffa3e-fd38-4780-8dbc-66566b538b6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:08.115736 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c01ffa3e-fd38-4780-8dbc-66566b538b6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:08.141281 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=91 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:08.209309 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c01ffa3e-fd38-4780-8dbc-66566b538b6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:08.222909 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c01ffa3e-fd38-4780-8dbc-66566b538b6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:08.224288 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c01ffa3e-fd38-4780-8dbc-66566b538b6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:08.225427 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-c01ffa3e-fd38-4780-8dbc-66566b538b6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.130734 Sep 01 17:37:08.227079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 43/74] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:08 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:08.249396 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-584b34e1-be19-480f-ba56-c054bfc75246 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:08.250070 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-584b34e1-be19-480f-ba56-c054bfc75246 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:08.252926 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:08.257685 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-584b34e1-be19-480f-ba56-c054bfc75246 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:08.258139 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-584b34e1-be19-480f-ba56-c054bfc75246 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:08.259004 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-584b34e1-be19-480f-ba56-c054bfc75246 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:08.260234 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-584b34e1-be19-480f-ba56-c054bfc75246 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:08.261347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-584b34e1-be19-480f-ba56-c054bfc75246 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:08.261816 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-584b34e1-be19-480f-ba56-c054bfc75246 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:08.492616 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-584b34e1-be19-480f-ba56-c054bfc75246 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:08.502391 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-584b34e1-be19-480f-ba56-c054bfc75246 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.257648 Sep 01 17:37:08.502853 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 32/75] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:08 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:08.644496 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8c7b4c0d-61d4-4243-9696-6add609dfa42 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:08.645117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8c7b4c0d-61d4-4243-9696-6add609dfa42 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:08.651646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c7b4c0d-61d4-4243-9696-6add609dfa42 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:08.652130 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c7b4c0d-61d4-4243-9696-6add609dfa42 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:08.652568 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c7b4c0d-61d4-4243-9696-6add609dfa42 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:08.653320 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c7b4c0d-61d4-4243-9696-6add609dfa42 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:08.654011 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c7b4c0d-61d4-4243-9696-6add609dfa42 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:08.654439 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c7b4c0d-61d4-4243-9696-6add609dfa42 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:08.794692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8c7b4c0d-61d4-4243-9696-6add609dfa42 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:08.802625 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8c7b4c0d-61d4-4243-9696-6add609dfa42 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.162510 Sep 01 17:37:08.803200 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 44/76] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:08 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:09.249505 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a23fc03a-907b-4044-9986-3e4fdd3d3b06 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:09.250426 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a23fc03a-907b-4044-9986-3e4fdd3d3b06 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:09.258379 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a23fc03a-907b-4044-9986-3e4fdd3d3b06 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:09.258867 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a23fc03a-907b-4044-9986-3e4fdd3d3b06 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:09.259302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a23fc03a-907b-4044-9986-3e4fdd3d3b06 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:09.260038 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a23fc03a-907b-4044-9986-3e4fdd3d3b06 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:09.260586 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a23fc03a-907b-4044-9986-3e4fdd3d3b06 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:09.261022 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a23fc03a-907b-4044-9986-3e4fdd3d3b06 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:09.334614 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a23fc03a-907b-4044-9986-3e4fdd3d3b06 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:09.343479 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a23fc03a-907b-4044-9986-3e4fdd3d3b06 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:09.344968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a23fc03a-907b-4044-9986-3e4fdd3d3b06 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:09.345974 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a23fc03a-907b-4044-9986-3e4fdd3d3b06 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.100431 Sep 01 17:37:09.346522 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 33/77] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:09 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:09.523693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e3b94c7a-2be6-4c33-b965-c80232ed98b7 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:09.524299 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e3b94c7a-2be6-4c33-b965-c80232ed98b7 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:09.531040 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3b94c7a-2be6-4c33-b965-c80232ed98b7 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:09.531514 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3b94c7a-2be6-4c33-b965-c80232ed98b7 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:09.531937 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3b94c7a-2be6-4c33-b965-c80232ed98b7 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:09.532615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3b94c7a-2be6-4c33-b965-c80232ed98b7 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:09.533711 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3b94c7a-2be6-4c33-b965-c80232ed98b7 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:09.534146 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3b94c7a-2be6-4c33-b965-c80232ed98b7 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:09.619611 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:09.667824 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e3b94c7a-2be6-4c33-b965-c80232ed98b7 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:09.675409 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e3b94c7a-2be6-4c33-b965-c80232ed98b7 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.155473 Sep 01 17:37:09.675975 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 45/78] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:09 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:09.823751 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2cb1a286-2cf3-46ac-b1d2-30d394608dea tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:09.824357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2cb1a286-2cf3-46ac-b1d2-30d394608dea tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:09.830369 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2cb1a286-2cf3-46ac-b1d2-30d394608dea tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:09.830843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2cb1a286-2cf3-46ac-b1d2-30d394608dea tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:09.831273 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2cb1a286-2cf3-46ac-b1d2-30d394608dea tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:09.831950 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2cb1a286-2cf3-46ac-b1d2-30d394608dea tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:09.832398 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2cb1a286-2cf3-46ac-b1d2-30d394608dea tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:09.832822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2cb1a286-2cf3-46ac-b1d2-30d394608dea tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:09.964229 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2cb1a286-2cf3-46ac-b1d2-30d394608dea tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:09.971703 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2cb1a286-2cf3-46ac-b1d2-30d394608dea tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.151774 Sep 01 17:37:09.972256 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 34/79] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:09 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:10.368688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0ba2da87-c1f3-4515-bf66-2225f5e2cf89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:10.369336 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0ba2da87-c1f3-4515-bf66-2225f5e2cf89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:10.375614 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0ba2da87-c1f3-4515-bf66-2225f5e2cf89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:10.376329 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0ba2da87-c1f3-4515-bf66-2225f5e2cf89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:10.376768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0ba2da87-c1f3-4515-bf66-2225f5e2cf89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:10.377483 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0ba2da87-c1f3-4515-bf66-2225f5e2cf89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:10.377968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0ba2da87-c1f3-4515-bf66-2225f5e2cf89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:10.378402 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0ba2da87-c1f3-4515-bf66-2225f5e2cf89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:10.446052 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0ba2da87-c1f3-4515-bf66-2225f5e2cf89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:10.455886 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0ba2da87-c1f3-4515-bf66-2225f5e2cf89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:10.457300 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0ba2da87-c1f3-4515-bf66-2225f5e2cf89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:10.458477 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0ba2da87-c1f3-4515-bf66-2225f5e2cf89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.093761 Sep 01 17:37:10.459034 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 46/80] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:10 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:10.696203 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-52fe6311-9f7b-4977-b048-af332af6180a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:10.696811 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-52fe6311-9f7b-4977-b048-af332af6180a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:10.699354 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=4 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:10.704731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-52fe6311-9f7b-4977-b048-af332af6180a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:10.705206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-52fe6311-9f7b-4977-b048-af332af6180a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:10.705664 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-52fe6311-9f7b-4977-b048-af332af6180a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:10.706396 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-52fe6311-9f7b-4977-b048-af332af6180a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:10.706798 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-52fe6311-9f7b-4977-b048-af332af6180a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:10.707212 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-52fe6311-9f7b-4977-b048-af332af6180a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:10.836725 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-52fe6311-9f7b-4977-b048-af332af6180a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:10.845242 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-52fe6311-9f7b-4977-b048-af332af6180a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.152677 Sep 01 17:37:10.845719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 35/81] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:10 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:10.998726 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-eed70603-a62d-47e5-94c5-d681f261b9b8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:11.001005 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-eed70603-a62d-47e5-94c5-d681f261b9b8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:11.007493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eed70603-a62d-47e5-94c5-d681f261b9b8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:11.007981 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eed70603-a62d-47e5-94c5-d681f261b9b8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:11.008577 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eed70603-a62d-47e5-94c5-d681f261b9b8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:11.009307 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eed70603-a62d-47e5-94c5-d681f261b9b8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:11.009849 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eed70603-a62d-47e5-94c5-d681f261b9b8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:11.010462 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eed70603-a62d-47e5-94c5-d681f261b9b8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:11.140332 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-eed70603-a62d-47e5-94c5-d681f261b9b8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:11.148290 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-eed70603-a62d-47e5-94c5-d681f261b9b8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.157883 Sep 01 17:37:11.148926 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 47/82] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:10 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:11.481983 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9c1b6c4f-bc4d-45b8-8045-1b3844ed2ff4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:11.482592 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9c1b6c4f-bc4d-45b8-8045-1b3844ed2ff4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:11.484505 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=16 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:11.490518 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9c1b6c4f-bc4d-45b8-8045-1b3844ed2ff4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:11.491006 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9c1b6c4f-bc4d-45b8-8045-1b3844ed2ff4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:11.491477 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9c1b6c4f-bc4d-45b8-8045-1b3844ed2ff4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:11.492315 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9c1b6c4f-bc4d-45b8-8045-1b3844ed2ff4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:11.492832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9c1b6c4f-bc4d-45b8-8045-1b3844ed2ff4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:11.493255 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9c1b6c4f-bc4d-45b8-8045-1b3844ed2ff4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:11.563938 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9c1b6c4f-bc4d-45b8-8045-1b3844ed2ff4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:11.567473 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=100 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:11.574010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9c1b6c4f-bc4d-45b8-8045-1b3844ed2ff4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:11.575603 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9c1b6c4f-bc4d-45b8-8045-1b3844ed2ff4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:11.576788 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9c1b6c4f-bc4d-45b8-8045-1b3844ed2ff4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.099536 Sep 01 17:37:11.577330 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 36/83] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:11 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:11.866657 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d847f50d-bb3d-423c-8497-953fd2d44d2c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:11.867341 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d847f50d-bb3d-423c-8497-953fd2d44d2c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:11.875556 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d847f50d-bb3d-423c-8497-953fd2d44d2c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:11.876044 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d847f50d-bb3d-423c-8497-953fd2d44d2c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:11.876484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d847f50d-bb3d-423c-8497-953fd2d44d2c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:11.877188 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d847f50d-bb3d-423c-8497-953fd2d44d2c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:11.877676 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d847f50d-bb3d-423c-8497-953fd2d44d2c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:11.878101 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d847f50d-bb3d-423c-8497-953fd2d44d2c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:12.047517 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d847f50d-bb3d-423c-8497-953fd2d44d2c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:12.067929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d847f50d-bb3d-423c-8497-953fd2d44d2c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.205181 Sep 01 17:37:12.071083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 48/84] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:11 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:12.169907 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-46f6e6d4-0053-48a2-8bf2-924d2ba45344 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:12.170595 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-46f6e6d4-0053-48a2-8bf2-924d2ba45344 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:12.176731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-46f6e6d4-0053-48a2-8bf2-924d2ba45344 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:12.177214 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-46f6e6d4-0053-48a2-8bf2-924d2ba45344 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:12.177677 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-46f6e6d4-0053-48a2-8bf2-924d2ba45344 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:12.178366 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-46f6e6d4-0053-48a2-8bf2-924d2ba45344 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:12.178893 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-46f6e6d4-0053-48a2-8bf2-924d2ba45344 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:12.179301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-46f6e6d4-0053-48a2-8bf2-924d2ba45344 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:12.329186 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-46f6e6d4-0053-48a2-8bf2-924d2ba45344 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:12.339403 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-46f6e6d4-0053-48a2-8bf2-924d2ba45344 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.173695 Sep 01 17:37:12.340342 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 37/85] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:12 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:12.600012 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-79b2fbb4-3d6d-4169-8622-d52eeec85a68 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:12.600612 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-79b2fbb4-3d6d-4169-8622-d52eeec85a68 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:12.608212 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-79b2fbb4-3d6d-4169-8622-d52eeec85a68 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:12.608692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-79b2fbb4-3d6d-4169-8622-d52eeec85a68 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:12.609116 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-79b2fbb4-3d6d-4169-8622-d52eeec85a68 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:12.609844 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-79b2fbb4-3d6d-4169-8622-d52eeec85a68 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:12.610292 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-79b2fbb4-3d6d-4169-8622-d52eeec85a68 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:12.610702 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-79b2fbb4-3d6d-4169-8622-d52eeec85a68 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:12.687833 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-79b2fbb4-3d6d-4169-8622-d52eeec85a68 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:12.699036 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-79b2fbb4-3d6d-4169-8622-d52eeec85a68 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:12.700603 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-79b2fbb4-3d6d-4169-8622-d52eeec85a68 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:12.701958 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-79b2fbb4-3d6d-4169-8622-d52eeec85a68 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.105863 Sep 01 17:37:12.702520 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 49/86] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:12 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:13.092518 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-28523166-0926-4ea6-bcef-ef7a3482c63b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:13.093128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-28523166-0926-4ea6-bcef-ef7a3482c63b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:13.099062 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-28523166-0926-4ea6-bcef-ef7a3482c63b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:13.099540 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-28523166-0926-4ea6-bcef-ef7a3482c63b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:13.099966 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-28523166-0926-4ea6-bcef-ef7a3482c63b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:13.100646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-28523166-0926-4ea6-bcef-ef7a3482c63b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:13.101093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-28523166-0926-4ea6-bcef-ef7a3482c63b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:13.101509 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-28523166-0926-4ea6-bcef-ef7a3482c63b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:13.246015 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-28523166-0926-4ea6-bcef-ef7a3482c63b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:13.253814 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-28523166-0926-4ea6-bcef-ef7a3482c63b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.165266 Sep 01 17:37:13.254386 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 38/87] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:13 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:13.361042 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6b347d09-952a-482b-84cc-8f9aeca5f87d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:13.361675 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6b347d09-952a-482b-84cc-8f9aeca5f87d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:13.367918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b347d09-952a-482b-84cc-8f9aeca5f87d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:13.368410 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b347d09-952a-482b-84cc-8f9aeca5f87d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:13.368995 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b347d09-952a-482b-84cc-8f9aeca5f87d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:13.370001 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b347d09-952a-482b-84cc-8f9aeca5f87d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:13.370539 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b347d09-952a-482b-84cc-8f9aeca5f87d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:13.370999 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b347d09-952a-482b-84cc-8f9aeca5f87d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:13.530098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-6b347d09-952a-482b-84cc-8f9aeca5f87d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:13.540696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-6b347d09-952a-482b-84cc-8f9aeca5f87d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.183895 Sep 01 17:37:13.553793 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 50/88] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:13 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:13.727072 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9d6274bc-df04-474f-b174-c09bc025fcbf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:13.728201 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9d6274bc-df04-474f-b174-c09bc025fcbf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:13.738157 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9d6274bc-df04-474f-b174-c09bc025fcbf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:13.738684 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9d6274bc-df04-474f-b174-c09bc025fcbf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:13.739111 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9d6274bc-df04-474f-b174-c09bc025fcbf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:13.739995 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9d6274bc-df04-474f-b174-c09bc025fcbf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:13.740849 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9d6274bc-df04-474f-b174-c09bc025fcbf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:13.741271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9d6274bc-df04-474f-b174-c09bc025fcbf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:13.814577 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9d6274bc-df04-474f-b174-c09bc025fcbf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:13.824885 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9d6274bc-df04-474f-b174-c09bc025fcbf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:13.826476 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9d6274bc-df04-474f-b174-c09bc025fcbf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:13.827717 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9d6274bc-df04-474f-b174-c09bc025fcbf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.105574 Sep 01 17:37:13.829620 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 39/89] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:13 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:37:14.275118 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-49689b0a-32c2-4363-b3a9-0063b6eb1cdf tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:14.275801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-49689b0a-32c2-4363-b3a9-0063b6eb1cdf tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:14.281705 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-49689b0a-32c2-4363-b3a9-0063b6eb1cdf tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:14.282182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-49689b0a-32c2-4363-b3a9-0063b6eb1cdf tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:14.282608 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-49689b0a-32c2-4363-b3a9-0063b6eb1cdf tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:14.283321 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-49689b0a-32c2-4363-b3a9-0063b6eb1cdf tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:14.283762 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-49689b0a-32c2-4363-b3a9-0063b6eb1cdf tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:14.284174 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-49689b0a-32c2-4363-b3a9-0063b6eb1cdf tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:14.413343 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-49689b0a-32c2-4363-b3a9-0063b6eb1cdf tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:14.421696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-49689b0a-32c2-4363-b3a9-0063b6eb1cdf tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.150366 Sep 01 17:37:14.422273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 51/90] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:14 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:14.562423 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-24f6260b-74bb-4c4f-8031-05d4620a35c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:14.562932 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-24f6260b-74bb-4c4f-8031-05d4620a35c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:14.568765 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24f6260b-74bb-4c4f-8031-05d4620a35c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:14.569251 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24f6260b-74bb-4c4f-8031-05d4620a35c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:14.569709 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24f6260b-74bb-4c4f-8031-05d4620a35c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:14.570384 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24f6260b-74bb-4c4f-8031-05d4620a35c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:14.570827 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24f6260b-74bb-4c4f-8031-05d4620a35c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:14.571242 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24f6260b-74bb-4c4f-8031-05d4620a35c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:14.705669 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-24f6260b-74bb-4c4f-8031-05d4620a35c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:14.714417 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-24f6260b-74bb-4c4f-8031-05d4620a35c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.156137 Sep 01 17:37:14.714988 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 40/91] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:14 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:14.850136 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3fb99560-62ca-40e5-9391-bca8bea50573 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:14.850841 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3fb99560-62ca-40e5-9391-bca8bea50573 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:14.856695 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3fb99560-62ca-40e5-9391-bca8bea50573 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:14.857363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3fb99560-62ca-40e5-9391-bca8bea50573 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:14.857635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3fb99560-62ca-40e5-9391-bca8bea50573 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:14.858328 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3fb99560-62ca-40e5-9391-bca8bea50573 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:14.858778 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3fb99560-62ca-40e5-9391-bca8bea50573 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:14.859204 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3fb99560-62ca-40e5-9391-bca8bea50573 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:14.926203 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3fb99560-62ca-40e5-9391-bca8bea50573 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:14.934691 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3fb99560-62ca-40e5-9391-bca8bea50573 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:14.936140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3fb99560-62ca-40e5-9391-bca8bea50573 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:14.937248 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3fb99560-62ca-40e5-9391-bca8bea50573 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.090950 Sep 01 17:37:14.937896 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 52/92] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:14 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:15.443248 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-87ad8d67-84fa-4ff2-9a27-8d3218ddb649 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:15.443878 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-87ad8d67-84fa-4ff2-9a27-8d3218ddb649 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:15.449873 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-87ad8d67-84fa-4ff2-9a27-8d3218ddb649 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:15.450355 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-87ad8d67-84fa-4ff2-9a27-8d3218ddb649 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:15.450792 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-87ad8d67-84fa-4ff2-9a27-8d3218ddb649 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:15.451473 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-87ad8d67-84fa-4ff2-9a27-8d3218ddb649 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:15.451949 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-87ad8d67-84fa-4ff2-9a27-8d3218ddb649 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:15.452370 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-87ad8d67-84fa-4ff2-9a27-8d3218ddb649 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:15.593523 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-87ad8d67-84fa-4ff2-9a27-8d3218ddb649 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:15.601194 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-87ad8d67-84fa-4ff2-9a27-8d3218ddb649 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.161828 Sep 01 17:37:15.601786 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 41/93] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:15 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:15.738593 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e4f60c11-e471-4e4b-a4e2-26604c107823 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:15.739613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e4f60c11-e471-4e4b-a4e2-26604c107823 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:15.746482 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e4f60c11-e471-4e4b-a4e2-26604c107823 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:15.747043 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e4f60c11-e471-4e4b-a4e2-26604c107823 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:15.747579 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e4f60c11-e471-4e4b-a4e2-26604c107823 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:15.748370 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e4f60c11-e471-4e4b-a4e2-26604c107823 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:15.749075 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e4f60c11-e471-4e4b-a4e2-26604c107823 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:15.749650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e4f60c11-e471-4e4b-a4e2-26604c107823 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:15.884255 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e4f60c11-e471-4e4b-a4e2-26604c107823 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:15.893230 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e4f60c11-e471-4e4b-a4e2-26604c107823 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.160506 Sep 01 17:37:15.893843 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 53/94] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:15 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:15.960728 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3f45a1a6-cb23-48de-97f2-9e27e622869f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:15.961619 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3f45a1a6-cb23-48de-97f2-9e27e622869f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:15.979494 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f45a1a6-cb23-48de-97f2-9e27e622869f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:15.980175 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f45a1a6-cb23-48de-97f2-9e27e622869f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:15.987673 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f45a1a6-cb23-48de-97f2-9e27e622869f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:15.989207 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f45a1a6-cb23-48de-97f2-9e27e622869f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:15.990223 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f45a1a6-cb23-48de-97f2-9e27e622869f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:15.991161 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f45a1a6-cb23-48de-97f2-9e27e622869f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:16.091566 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3f45a1a6-cb23-48de-97f2-9e27e622869f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:16.101348 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3f45a1a6-cb23-48de-97f2-9e27e622869f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:16.103048 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3f45a1a6-cb23-48de-97f2-9e27e622869f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:16.104380 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-3f45a1a6-cb23-48de-97f2-9e27e622869f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.148455 Sep 01 17:37:16.104946 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 42/95] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:15 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:16.622173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2d146827-acb8-43f7-8709-fa8afe35b746 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:16.622689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2d146827-acb8-43f7-8709-fa8afe35b746 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:16.628608 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d146827-acb8-43f7-8709-fa8afe35b746 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:16.629086 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d146827-acb8-43f7-8709-fa8afe35b746 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:16.629525 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d146827-acb8-43f7-8709-fa8afe35b746 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:16.630227 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d146827-acb8-43f7-8709-fa8afe35b746 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:16.630678 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d146827-acb8-43f7-8709-fa8afe35b746 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:16.631094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d146827-acb8-43f7-8709-fa8afe35b746 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:16.777503 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2d146827-acb8-43f7-8709-fa8afe35b746 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:16.789694 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2d146827-acb8-43f7-8709-fa8afe35b746 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.171397 Sep 01 17:37:16.790313 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 54/96] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:16 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:16.914537 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-024480c5-aa0f-4833-a1e8-af3240d2b6fb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:16.916413 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-024480c5-aa0f-4833-a1e8-af3240d2b6fb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:16.922466 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-024480c5-aa0f-4833-a1e8-af3240d2b6fb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:16.923021 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-024480c5-aa0f-4833-a1e8-af3240d2b6fb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:16.923532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-024480c5-aa0f-4833-a1e8-af3240d2b6fb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:16.924392 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-024480c5-aa0f-4833-a1e8-af3240d2b6fb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:16.924826 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-024480c5-aa0f-4833-a1e8-af3240d2b6fb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:16.925310 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-024480c5-aa0f-4833-a1e8-af3240d2b6fb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:17.072638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-024480c5-aa0f-4833-a1e8-af3240d2b6fb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:17.081258 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-024480c5-aa0f-4833-a1e8-af3240d2b6fb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.170606 Sep 01 17:37:17.081987 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 43/97] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:16 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:17.128102 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c4355c19-ebae-4c2d-b622-340bc7710e4c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:17.128653 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c4355c19-ebae-4c2d-b622-340bc7710e4c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:17.137004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c4355c19-ebae-4c2d-b622-340bc7710e4c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:17.137653 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c4355c19-ebae-4c2d-b622-340bc7710e4c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:17.138383 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c4355c19-ebae-4c2d-b622-340bc7710e4c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:17.139072 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c4355c19-ebae-4c2d-b622-340bc7710e4c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:17.139583 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c4355c19-ebae-4c2d-b622-340bc7710e4c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:17.140117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c4355c19-ebae-4c2d-b622-340bc7710e4c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:17.207244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c4355c19-ebae-4c2d-b622-340bc7710e4c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:17.216372 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c4355c19-ebae-4c2d-b622-340bc7710e4c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:17.217934 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c4355c19-ebae-4c2d-b622-340bc7710e4c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:17.219117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-c4355c19-ebae-4c2d-b622-340bc7710e4c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.095099 Sep 01 17:37:17.219760 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 55/98] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:17 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:17.812171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-1fd24fd2-1d86-4aa2-896c-56ea3ae4f9e4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:17.812782 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-1fd24fd2-1d86-4aa2-896c-56ea3ae4f9e4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:17.818727 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1fd24fd2-1d86-4aa2-896c-56ea3ae4f9e4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:17.819212 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1fd24fd2-1d86-4aa2-896c-56ea3ae4f9e4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:17.819651 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1fd24fd2-1d86-4aa2-896c-56ea3ae4f9e4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:17.820435 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1fd24fd2-1d86-4aa2-896c-56ea3ae4f9e4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:17.820830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1fd24fd2-1d86-4aa2-896c-56ea3ae4f9e4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:17.821254 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1fd24fd2-1d86-4aa2-896c-56ea3ae4f9e4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:17.966177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1fd24fd2-1d86-4aa2-896c-56ea3ae4f9e4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:17.973694 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-1fd24fd2-1d86-4aa2-896c-56ea3ae4f9e4 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.165353 Sep 01 17:37:17.974257 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 44/99] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:17 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:18.102868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a175dbdb-d3f6-49c4-a37e-413cfc11d355 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:18.104114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a175dbdb-d3f6-49c4-a37e-413cfc11d355 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:18.110207 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a175dbdb-d3f6-49c4-a37e-413cfc11d355 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:18.110693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a175dbdb-d3f6-49c4-a37e-413cfc11d355 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:18.111132 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a175dbdb-d3f6-49c4-a37e-413cfc11d355 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:18.111832 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a175dbdb-d3f6-49c4-a37e-413cfc11d355 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:18.112287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a175dbdb-d3f6-49c4-a37e-413cfc11d355 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:18.112710 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a175dbdb-d3f6-49c4-a37e-413cfc11d355 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:18.243149 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a175dbdb-d3f6-49c4-a37e-413cfc11d355 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:18.243740 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a2f7efe6-6711-4223-85c3-a7fc5b6be887 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:18.244393 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a2f7efe6-6711-4223-85c3-a7fc5b6be887 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:18.250313 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a2f7efe6-6711-4223-85c3-a7fc5b6be887 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:18.250794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a2f7efe6-6711-4223-85c3-a7fc5b6be887 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:18.251583 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a2f7efe6-6711-4223-85c3-a7fc5b6be887 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:18.251845 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a175dbdb-d3f6-49c4-a37e-413cfc11d355 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.152641 Sep 01 17:37:18.251955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a2f7efe6-6711-4223-85c3-a7fc5b6be887 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:18.252366 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a2f7efe6-6711-4223-85c3-a7fc5b6be887 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:18.252630 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 56/100] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:18 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:18.252753 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a2f7efe6-6711-4223-85c3-a7fc5b6be887 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:18.317016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a2f7efe6-6711-4223-85c3-a7fc5b6be887 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:18.326177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a2f7efe6-6711-4223-85c3-a7fc5b6be887 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:18.327627 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a2f7efe6-6711-4223-85c3-a7fc5b6be887 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:18.328762 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a2f7efe6-6711-4223-85c3-a7fc5b6be887 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1337 microversion: 2.20 time: 0.089218 Sep 01 17:37:18.329312 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 45/101] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:18 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1337 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:37:19.007164 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-707d61ad-9207-49e5-a87b-faddfde7955f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:19.010150 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-707d61ad-9207-49e5-a87b-faddfde7955f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:19.032440 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-707d61ad-9207-49e5-a87b-faddfde7955f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:19.033017 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-707d61ad-9207-49e5-a87b-faddfde7955f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:19.036062 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-707d61ad-9207-49e5-a87b-faddfde7955f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:19.037708 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-707d61ad-9207-49e5-a87b-faddfde7955f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:19.042165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-707d61ad-9207-49e5-a87b-faddfde7955f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:19.042830 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-707d61ad-9207-49e5-a87b-faddfde7955f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:19.272547 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-db6aa85e-7065-4db3-971a-39b1714d5975 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:19.273160 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-db6aa85e-7065-4db3-971a-39b1714d5975 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:19.287991 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-db6aa85e-7065-4db3-971a-39b1714d5975 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:19.294198 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-db6aa85e-7065-4db3-971a-39b1714d5975 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:19.299215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-db6aa85e-7065-4db3-971a-39b1714d5975 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:19.302969 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-db6aa85e-7065-4db3-971a-39b1714d5975 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:19.303597 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-db6aa85e-7065-4db3-971a-39b1714d5975 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:19.306212 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-db6aa85e-7065-4db3-971a-39b1714d5975 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:19.340504 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-707d61ad-9207-49e5-a87b-faddfde7955f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:19.351997 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-707d61ad-9207-49e5-a87b-faddfde7955f tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.356301 Sep 01 17:37:19.354441 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 57/102] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:18 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:19.361190 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c4a39319-4efc-4375-88e3-d4bccb9731ff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:19.362689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c4a39319-4efc-4375-88e3-d4bccb9731ff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:19.383076 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c4a39319-4efc-4375-88e3-d4bccb9731ff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:19.384045 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c4a39319-4efc-4375-88e3-d4bccb9731ff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:19.388383 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c4a39319-4efc-4375-88e3-d4bccb9731ff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:19.388558 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c4a39319-4efc-4375-88e3-d4bccb9731ff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:19.389033 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c4a39319-4efc-4375-88e3-d4bccb9731ff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:19.390661 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c4a39319-4efc-4375-88e3-d4bccb9731ff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:19.520915 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c4a39319-4efc-4375-88e3-d4bccb9731ff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:19.537770 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c4a39319-4efc-4375-88e3-d4bccb9731ff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:19.545260 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c4a39319-4efc-4375-88e3-d4bccb9731ff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:19.547546 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-c4a39319-4efc-4375-88e3-d4bccb9731ff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1343 microversion: 2.20 time: 0.191600 Sep 01 17:37:19.554598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 58/103] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:19 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:19.772269 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-db6aa85e-7065-4db3-971a-39b1714d5975 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:19.804925 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-db6aa85e-7065-4db3-971a-39b1714d5975 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.536136 Sep 01 17:37:19.838012 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 46/104] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:19 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:20.377110 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a551f5fd-e3c7-4053-994d-8958ad782987 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:20.377762 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a551f5fd-e3c7-4053-994d-8958ad782987 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:20.392693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a551f5fd-e3c7-4053-994d-8958ad782987 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:20.393625 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a551f5fd-e3c7-4053-994d-8958ad782987 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:20.394597 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a551f5fd-e3c7-4053-994d-8958ad782987 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:20.395699 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a551f5fd-e3c7-4053-994d-8958ad782987 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:20.396623 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a551f5fd-e3c7-4053-994d-8958ad782987 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:20.397384 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a551f5fd-e3c7-4053-994d-8958ad782987 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:20.578201 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f00cf587-026d-492c-97ef-2f8e024076d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:20.578898 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f00cf587-026d-492c-97ef-2f8e024076d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:20.597236 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f00cf587-026d-492c-97ef-2f8e024076d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:20.598420 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f00cf587-026d-492c-97ef-2f8e024076d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:20.599024 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f00cf587-026d-492c-97ef-2f8e024076d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:20.600765 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f00cf587-026d-492c-97ef-2f8e024076d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:20.601407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f00cf587-026d-492c-97ef-2f8e024076d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:20.602134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f00cf587-026d-492c-97ef-2f8e024076d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:20.731243 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a551f5fd-e3c7-4053-994d-8958ad782987 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:20.742419 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=100 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:20.752895 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a551f5fd-e3c7-4053-994d-8958ad782987 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.379721 Sep 01 17:37:20.765092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 59/105] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:20 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:20.802369 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f00cf587-026d-492c-97ef-2f8e024076d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:20.812929 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f00cf587-026d-492c-97ef-2f8e024076d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:20.815154 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f00cf587-026d-492c-97ef-2f8e024076d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:20.816719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f00cf587-026d-492c-97ef-2f8e024076d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.243849 Sep 01 17:37:20.829657 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 47/106] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:20 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:37:20.834133 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-35a3b622-c963-4758-93b3-16a9651a7c3e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:20.842685 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-35a3b622-c963-4758-93b3-16a9651a7c3e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:20.855243 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-35a3b622-c963-4758-93b3-16a9651a7c3e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:20.855745 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-35a3b622-c963-4758-93b3-16a9651a7c3e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:20.856202 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-35a3b622-c963-4758-93b3-16a9651a7c3e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:20.863170 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-2de5eb91-87ae-4c66-9dc7-473f020c17a7 req-29261780-08c1-4e13-bc83-7eb991e1d044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2905128c-3c89-498f-92c1-7c4bce87f75c", "name": "network-vif-plugged", "status": "completed", "tag": "f202a908-6c12-487f-a321-2dd4650a0faf"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:20.869075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-35a3b622-c963-4758-93b3-16a9651a7c3e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:20.869565 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-35a3b622-c963-4758-93b3-16a9651a7c3e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:20.874203 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-35a3b622-c963-4758-93b3-16a9651a7c3e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:20.881537 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-2de5eb91-87ae-4c66-9dc7-473f020c17a7 req-29261780-08c1-4e13-bc83-7eb991e1d044 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:20.882410 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-2de5eb91-87ae-4c66-9dc7-473f020c17a7 req-29261780-08c1-4e13-bc83-7eb991e1d044 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:20.883155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-2de5eb91-87ae-4c66-9dc7-473f020c17a7 req-29261780-08c1-4e13-bc83-7eb991e1d044 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:20.901011 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-2de5eb91-87ae-4c66-9dc7-473f020c17a7 req-29261780-08c1-4e13-bc83-7eb991e1d044 service nova] Creating event network-vif-plugged:f202a908-6c12-487f-a321-2dd4650a0faf for instance 2905128c-3c89-498f-92c1-7c4bce87f75c on hv-cinder-83976 Sep 01 17:37:20.907473 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-2de5eb91-87ae-4c66-9dc7-473f020c17a7 req-29261780-08c1-4e13-bc83-7eb991e1d044 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152141 Sep 01 17:37:20.909271 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 60/107] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:37:21.036725 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-35a3b622-c963-4758-93b3-16a9651a7c3e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:21.046718 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-35a3b622-c963-4758-93b3-16a9651a7c3e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.217319 Sep 01 17:37:21.047808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 48/108] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:20 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:21.778946 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f1226c0d-1919-4924-9744-eb8880257e30 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:21.779646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f1226c0d-1919-4924-9744-eb8880257e30 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:21.786588 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f1226c0d-1919-4924-9744-eb8880257e30 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:21.787075 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f1226c0d-1919-4924-9744-eb8880257e30 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:21.787504 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f1226c0d-1919-4924-9744-eb8880257e30 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:21.788190 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f1226c0d-1919-4924-9744-eb8880257e30 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:21.788644 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f1226c0d-1919-4924-9744-eb8880257e30 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:21.789061 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f1226c0d-1919-4924-9744-eb8880257e30 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:21.841739 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e51a9500-f3ab-41f7-9fb1-a7cd8d6f561d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:21.842355 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e51a9500-f3ab-41f7-9fb1-a7cd8d6f561d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:21.848619 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e51a9500-f3ab-41f7-9fb1-a7cd8d6f561d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:21.849170 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e51a9500-f3ab-41f7-9fb1-a7cd8d6f561d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:21.849560 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e51a9500-f3ab-41f7-9fb1-a7cd8d6f561d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:21.850287 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e51a9500-f3ab-41f7-9fb1-a7cd8d6f561d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:21.850679 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e51a9500-f3ab-41f7-9fb1-a7cd8d6f561d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:21.851091 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e51a9500-f3ab-41f7-9fb1-a7cd8d6f561d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:21.991437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f1226c0d-1919-4924-9744-eb8880257e30 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:21.999515 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f1226c0d-1919-4924-9744-eb8880257e30 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.225882 Sep 01 17:37:22.000090 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 61/109] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:21 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:22.021499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e51a9500-f3ab-41f7-9fb1-a7cd8d6f561d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:22.031689 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e51a9500-f3ab-41f7-9fb1-a7cd8d6f561d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:22.033129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e51a9500-f3ab-41f7-9fb1-a7cd8d6f561d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:22.034426 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e51a9500-f3ab-41f7-9fb1-a7cd8d6f561d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.197525 Sep 01 17:37:22.035000 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 49/110] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:21 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:37:22.069944 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8fb91386-5be6-4775-951f-688e822ff547 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:22.070513 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8fb91386-5be6-4775-951f-688e822ff547 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:22.077064 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8fb91386-5be6-4775-951f-688e822ff547 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:22.077544 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8fb91386-5be6-4775-951f-688e822ff547 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:22.078001 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8fb91386-5be6-4775-951f-688e822ff547 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:22.078699 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8fb91386-5be6-4775-951f-688e822ff547 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:22.079152 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8fb91386-5be6-4775-951f-688e822ff547 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:22.079567 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8fb91386-5be6-4775-951f-688e822ff547 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:22.278744 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8fb91386-5be6-4775-951f-688e822ff547 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:22.286986 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8fb91386-5be6-4775-951f-688e822ff547 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.220613 Sep 01 17:37:22.287569 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 62/111] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:22 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:23.027573 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ddb65ac4-e9f9-4425-9b66-effdcb574394 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:23.028784 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ddb65ac4-e9f9-4425-9b66-effdcb574394 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:23.043328 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ddb65ac4-e9f9-4425-9b66-effdcb574394 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:23.044185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ddb65ac4-e9f9-4425-9b66-effdcb574394 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:23.044900 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ddb65ac4-e9f9-4425-9b66-effdcb574394 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:23.046006 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ddb65ac4-e9f9-4425-9b66-effdcb574394 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:23.046681 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ddb65ac4-e9f9-4425-9b66-effdcb574394 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:23.047745 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ddb65ac4-e9f9-4425-9b66-effdcb574394 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:23.061255 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-37584b57-3c52-4d1f-aedf-e331b3e21d5e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:23.062458 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-37584b57-3c52-4d1f-aedf-e331b3e21d5e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:23.070047 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-37584b57-3c52-4d1f-aedf-e331b3e21d5e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:23.070678 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-37584b57-3c52-4d1f-aedf-e331b3e21d5e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:23.071115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-37584b57-3c52-4d1f-aedf-e331b3e21d5e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:23.071849 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-37584b57-3c52-4d1f-aedf-e331b3e21d5e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:23.072301 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-37584b57-3c52-4d1f-aedf-e331b3e21d5e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:23.072719 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-37584b57-3c52-4d1f-aedf-e331b3e21d5e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:23.288971 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ddb65ac4-e9f9-4425-9b66-effdcb574394 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:23.294044 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-37584b57-3c52-4d1f-aedf-e331b3e21d5e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:23.299481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ddb65ac4-e9f9-4425-9b66-effdcb574394 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.279315 Sep 01 17:37:23.302619 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-37584b57-3c52-4d1f-aedf-e331b3e21d5e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:23.304457 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-37584b57-3c52-4d1f-aedf-e331b3e21d5e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:23.305801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-37584b57-3c52-4d1f-aedf-e331b3e21d5e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.251613 Sep 01 17:37:23.307278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 63/112] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:23 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:23.312133 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-eb759997-124b-4074-a25a-9fd6a94a47f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:23.312913 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-eb759997-124b-4074-a25a-9fd6a94a47f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:23.315078 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 50/113] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:23 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:23.319211 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eb759997-124b-4074-a25a-9fd6a94a47f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:23.319692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eb759997-124b-4074-a25a-9fd6a94a47f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:23.320117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eb759997-124b-4074-a25a-9fd6a94a47f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:23.320792 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eb759997-124b-4074-a25a-9fd6a94a47f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:23.321438 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eb759997-124b-4074-a25a-9fd6a94a47f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:23.322504 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eb759997-124b-4074-a25a-9fd6a94a47f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:23.600046 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-eb759997-124b-4074-a25a-9fd6a94a47f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:23.624203 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-eb759997-124b-4074-a25a-9fd6a94a47f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.314569 Sep 01 17:37:23.641113 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 64/114] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:23 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:24.233977 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-6e41ec63-9fe3-430d-ab4c-6ce8b9b7dafd req-a7647073-608d-4696-83d6-65973f59e83a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc52ad3-09b3-4851-8a50-ad446bd1a75d", "tag": "be99e7bf-5f6d-42df-82e3-b77a04fd7684"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:24.252153 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-6e41ec63-9fe3-430d-ab4c-6ce8b9b7dafd req-a7647073-608d-4696-83d6-65973f59e83a service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:24.253094 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-6e41ec63-9fe3-430d-ab4c-6ce8b9b7dafd req-a7647073-608d-4696-83d6-65973f59e83a service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:24.253844 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-6e41ec63-9fe3-430d-ab4c-6ce8b9b7dafd req-a7647073-608d-4696-83d6-65973f59e83a service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:24.279162 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-6e41ec63-9fe3-430d-ab4c-6ce8b9b7dafd req-a7647073-608d-4696-83d6-65973f59e83a service nova] Creating event network-changed:be99e7bf-5f6d-42df-82e3-b77a04fd7684 for instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d on hv-cinder-83976 Sep 01 17:37:24.280292 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-6e41ec63-9fe3-430d-ab4c-6ce8b9b7dafd req-a7647073-608d-4696-83d6-65973f59e83a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 17:37:24.280850 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-6e41ec63-9fe3-430d-ab4c-6ce8b9b7dafd req-a7647073-608d-4696-83d6-65973f59e83a service nova] Acquired lock "compute-rpcapi-router" {{(pid=127232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 17:37:24.282140 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dcc01719-9602-4863-877e-e1449ac5afaa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:24.282781 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dcc01719-9602-4863-877e-e1449ac5afaa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:24.283440 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dcc01719-9602-4863-877e-e1449ac5afaa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:24.284324 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dcc01719-9602-4863-877e-e1449ac5afaa None None] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:24.285408 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dcc01719-9602-4863-877e-e1449ac5afaa None None] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:24.286216 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dcc01719-9602-4863-877e-e1449ac5afaa None None] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:24.299503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.compute.rpcapi [None req-dcc01719-9602-4863-877e-e1449ac5afaa None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 17:37:24.301063 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dcc01719-9602-4863-877e-e1449ac5afaa None None] Releasing lock "compute-rpcapi-router" {{(pid=127232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 17:37:24.324736 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-dcc01719-9602-4863-877e-e1449ac5afaa None None] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094488 Sep 01 17:37:24.327805 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 51/115] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:37:24.328178 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b3bcd719-fc5c-40dd-be02-268635e1a02c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:24.330585 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-b3bcd719-fc5c-40dd-be02-268635e1a02c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:24.338247 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9fccf80a-b869-4ded-a135-8a50387b7a04 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:24.338968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9fccf80a-b869-4ded-a135-8a50387b7a04 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:24.345269 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3bcd719-fc5c-40dd-be02-268635e1a02c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:24.346412 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3bcd719-fc5c-40dd-be02-268635e1a02c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:24.347552 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3bcd719-fc5c-40dd-be02-268635e1a02c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:24.348613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3bcd719-fc5c-40dd-be02-268635e1a02c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:24.349568 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3bcd719-fc5c-40dd-be02-268635e1a02c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:24.350251 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3bcd719-fc5c-40dd-be02-268635e1a02c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:24.360313 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9fccf80a-b869-4ded-a135-8a50387b7a04 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:24.360947 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9fccf80a-b869-4ded-a135-8a50387b7a04 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:24.362076 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9fccf80a-b869-4ded-a135-8a50387b7a04 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:24.362893 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9fccf80a-b869-4ded-a135-8a50387b7a04 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:24.364979 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9fccf80a-b869-4ded-a135-8a50387b7a04 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:24.366318 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9fccf80a-b869-4ded-a135-8a50387b7a04 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:24.738550 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b3bcd719-fc5c-40dd-be02-268635e1a02c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:24.739083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9fccf80a-b869-4ded-a135-8a50387b7a04 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:24.748849 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-b3bcd719-fc5c-40dd-be02-268635e1a02c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.432289 Sep 01 17:37:24.755786 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 65/116] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:24 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:24.778736 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-35a94961-3887-4e57-91cd-7857164483d9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:24.779026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9fccf80a-b869-4ded-a135-8a50387b7a04 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:24.780063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-35a94961-3887-4e57-91cd-7857164483d9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:24.780585 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9fccf80a-b869-4ded-a135-8a50387b7a04 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:24.781935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9fccf80a-b869-4ded-a135-8a50387b7a04 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.451863 Sep 01 17:37:24.788633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35a94961-3887-4e57-91cd-7857164483d9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:24.789116 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 52/117] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:24 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:24.789716 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35a94961-3887-4e57-91cd-7857164483d9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:24.790980 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35a94961-3887-4e57-91cd-7857164483d9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:24.792041 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35a94961-3887-4e57-91cd-7857164483d9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:24.792658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35a94961-3887-4e57-91cd-7857164483d9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:24.793228 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35a94961-3887-4e57-91cd-7857164483d9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:25.080279 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-35a94961-3887-4e57-91cd-7857164483d9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:25.095814 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-35a94961-3887-4e57-91cd-7857164483d9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1325 microversion: 2.1 time: 0.334367 Sep 01 17:37:25.096408 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 66/118] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:24 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1325 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:25.773306 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4a6d41aa-93e7-4bed-8c2e-40eb2996e192 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:25.774850 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4a6d41aa-93e7-4bed-8c2e-40eb2996e192 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:25.788256 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a6d41aa-93e7-4bed-8c2e-40eb2996e192 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:25.789054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a6d41aa-93e7-4bed-8c2e-40eb2996e192 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:25.790712 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a6d41aa-93e7-4bed-8c2e-40eb2996e192 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:25.792527 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a6d41aa-93e7-4bed-8c2e-40eb2996e192 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:25.793941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a6d41aa-93e7-4bed-8c2e-40eb2996e192 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:25.795315 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a6d41aa-93e7-4bed-8c2e-40eb2996e192 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:25.814545 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a02eaef4-03d2-499d-af1d-982233634b24 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:25.815194 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a02eaef4-03d2-499d-af1d-982233634b24 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:25.822590 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a02eaef4-03d2-499d-af1d-982233634b24 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:25.827662 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a02eaef4-03d2-499d-af1d-982233634b24 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:25.828281 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a02eaef4-03d2-499d-af1d-982233634b24 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:25.834429 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a02eaef4-03d2-499d-af1d-982233634b24 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:25.835166 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a02eaef4-03d2-499d-af1d-982233634b24 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:25.835765 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a02eaef4-03d2-499d-af1d-982233634b24 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:26.433810 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4a6d41aa-93e7-4bed-8c2e-40eb2996e192 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:26.438398 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=100 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:26.450797 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4a6d41aa-93e7-4bed-8c2e-40eb2996e192 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.678497 Sep 01 17:37:26.451510 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 53/119] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:25 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:26.478941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4853b8b2-2b72-4f21-8c38-bca54667340e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:26.482434 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4853b8b2-2b72-4f21-8c38-bca54667340e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:26.501400 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4853b8b2-2b72-4f21-8c38-bca54667340e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:26.503650 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4853b8b2-2b72-4f21-8c38-bca54667340e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:26.504514 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4853b8b2-2b72-4f21-8c38-bca54667340e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:26.511656 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a02eaef4-03d2-499d-af1d-982233634b24 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:26.526571 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4853b8b2-2b72-4f21-8c38-bca54667340e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:26.528320 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4853b8b2-2b72-4f21-8c38-bca54667340e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:26.530413 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4853b8b2-2b72-4f21-8c38-bca54667340e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:26.536719 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a02eaef4-03d2-499d-af1d-982233634b24 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:26.539523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a02eaef4-03d2-499d-af1d-982233634b24 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:26.541409 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a02eaef4-03d2-499d-af1d-982233634b24 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.730245 Sep 01 17:37:26.542104 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 67/120] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:25 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:37:26.579427 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-e655a7f0-f071-4967-a8a3-6c80996fcc08 req-33a7ab7c-20ea-41ee-8d1f-9b61bddf0b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f637e8e-d6ed-4516-b57d-48174aa65926", "name": "network-vif-plugged", "status": "completed", "tag": "87b4da6d-8b68-433c-ae8f-43c4c9fda0c1"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:26.621600 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-e655a7f0-f071-4967-a8a3-6c80996fcc08 req-33a7ab7c-20ea-41ee-8d1f-9b61bddf0b84 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:26.626271 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-e655a7f0-f071-4967-a8a3-6c80996fcc08 req-33a7ab7c-20ea-41ee-8d1f-9b61bddf0b84 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:26.627557 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-e655a7f0-f071-4967-a8a3-6c80996fcc08 req-33a7ab7c-20ea-41ee-8d1f-9b61bddf0b84 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:26.660741 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-e655a7f0-f071-4967-a8a3-6c80996fcc08 req-33a7ab7c-20ea-41ee-8d1f-9b61bddf0b84 service nova] Creating event network-vif-plugged:87b4da6d-8b68-433c-ae8f-43c4c9fda0c1 for instance 0f637e8e-d6ed-4516-b57d-48174aa65926 on hv-cinder-83976 Sep 01 17:37:26.672599 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-e655a7f0-f071-4967-a8a3-6c80996fcc08 req-33a7ab7c-20ea-41ee-8d1f-9b61bddf0b84 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120124 Sep 01 17:37:26.676508 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 68/121] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:37:26.841142 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4853b8b2-2b72-4f21-8c38-bca54667340e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:26.852434 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4853b8b2-2b72-4f21-8c38-bca54667340e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1520 microversion: 2.1 time: 0.381795 Sep 01 17:37:26.854416 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 54/122] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:26 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:26.876399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0f306a1e-0ebe-47be-b800-92c0577643d1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:26.879524 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0f306a1e-0ebe-47be-b800-92c0577643d1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:26.887732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f306a1e-0ebe-47be-b800-92c0577643d1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:26.888844 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f306a1e-0ebe-47be-b800-92c0577643d1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:26.889678 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f306a1e-0ebe-47be-b800-92c0577643d1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:26.890450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f306a1e-0ebe-47be-b800-92c0577643d1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:26.891836 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f306a1e-0ebe-47be-b800-92c0577643d1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:26.892696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f306a1e-0ebe-47be-b800-92c0577643d1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:26.964689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-0f306a1e-0ebe-47be-b800-92c0577643d1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lazy-loading 'flavor' on Instance uuid 2905128c-3c89-498f-92c1-7c4bce87f75c {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:37:27.148457 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0f306a1e-0ebe-47be-b800-92c0577643d1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "POST /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c/action" status: 200 len: 32 microversion: 2.1 time: 0.277087 Sep 01 17:37:27.153759 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 69/123] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:37:26 2022] POST /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c/action => generated 32 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:37:27.159132 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-428566bd-2f6f-4230-8ddd-29937a0c2517 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:27.159960 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-428566bd-2f6f-4230-8ddd-29937a0c2517 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:27.166547 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-428566bd-2f6f-4230-8ddd-29937a0c2517 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:27.167040 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-428566bd-2f6f-4230-8ddd-29937a0c2517 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:27.167691 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-428566bd-2f6f-4230-8ddd-29937a0c2517 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:27.169349 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-428566bd-2f6f-4230-8ddd-29937a0c2517 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:27.169349 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-428566bd-2f6f-4230-8ddd-29937a0c2517 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:27.169539 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-428566bd-2f6f-4230-8ddd-29937a0c2517 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:27.368804 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-428566bd-2f6f-4230-8ddd-29937a0c2517 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:27.379018 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-428566bd-2f6f-4230-8ddd-29937a0c2517 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.223666 Sep 01 17:37:27.380774 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 55/124] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:27 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:27.474037 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a2529bcf-940d-4d2c-8aaa-19ef6f316b4e tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:27.474758 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a2529bcf-940d-4d2c-8aaa-19ef6f316b4e tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:27.482120 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2529bcf-940d-4d2c-8aaa-19ef6f316b4e tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:27.482953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2529bcf-940d-4d2c-8aaa-19ef6f316b4e tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:27.483968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2529bcf-940d-4d2c-8aaa-19ef6f316b4e tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:27.484755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2529bcf-940d-4d2c-8aaa-19ef6f316b4e tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:27.485282 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2529bcf-940d-4d2c-8aaa-19ef6f316b4e tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:27.486000 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2529bcf-940d-4d2c-8aaa-19ef6f316b4e tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:27.563901 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bf32bc61-80cd-4ae2-95d5-ade2a0d3e83c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:27.565356 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bf32bc61-80cd-4ae2-95d5-ade2a0d3e83c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:27.576915 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bf32bc61-80cd-4ae2-95d5-ade2a0d3e83c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:27.577702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bf32bc61-80cd-4ae2-95d5-ade2a0d3e83c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:27.580277 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bf32bc61-80cd-4ae2-95d5-ade2a0d3e83c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:27.581279 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bf32bc61-80cd-4ae2-95d5-ade2a0d3e83c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:27.582119 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bf32bc61-80cd-4ae2-95d5-ade2a0d3e83c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:27.583220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bf32bc61-80cd-4ae2-95d5-ade2a0d3e83c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:27.843156 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a2529bcf-940d-4d2c-8aaa-19ef6f316b4e tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:27.856734 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a2529bcf-940d-4d2c-8aaa-19ef6f316b4e tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.387165 Sep 01 17:37:27.860510 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 70/125] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:27 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:27.873044 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bf32bc61-80cd-4ae2-95d5-ade2a0d3e83c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:27.885912 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bf32bc61-80cd-4ae2-95d5-ade2a0d3e83c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:27.888025 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bf32bc61-80cd-4ae2-95d5-ade2a0d3e83c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:27.889808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bf32bc61-80cd-4ae2-95d5-ade2a0d3e83c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.329483 Sep 01 17:37:27.890838 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 56/126] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:27 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:37:28.405418 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-072b629d-be1a-4743-97af-4ceb443b1ac3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:28.406343 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-072b629d-be1a-4743-97af-4ceb443b1ac3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:28.413209 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-072b629d-be1a-4743-97af-4ceb443b1ac3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:28.413739 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-072b629d-be1a-4743-97af-4ceb443b1ac3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:28.414370 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-072b629d-be1a-4743-97af-4ceb443b1ac3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:28.415293 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-072b629d-be1a-4743-97af-4ceb443b1ac3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:28.415763 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-072b629d-be1a-4743-97af-4ceb443b1ac3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:28.416165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-072b629d-be1a-4743-97af-4ceb443b1ac3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:28.607433 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-072b629d-be1a-4743-97af-4ceb443b1ac3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:28.615488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-072b629d-be1a-4743-97af-4ceb443b1ac3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.214370 Sep 01 17:37:28.616161 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 71/127] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:28 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:28.879337 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2689ddff-1bcb-415a-8c2c-6ab316632941 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:28.880669 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2689ddff-1bcb-415a-8c2c-6ab316632941 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:28.890050 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2689ddff-1bcb-415a-8c2c-6ab316632941 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:28.890050 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2689ddff-1bcb-415a-8c2c-6ab316632941 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:28.890050 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2689ddff-1bcb-415a-8c2c-6ab316632941 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:28.890050 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2689ddff-1bcb-415a-8c2c-6ab316632941 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:28.890374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2689ddff-1bcb-415a-8c2c-6ab316632941 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:28.890374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2689ddff-1bcb-415a-8c2c-6ab316632941 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:28.916100 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-69f50deb-5377-440c-83f3-3030deb24212 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:28.916823 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-69f50deb-5377-440c-83f3-3030deb24212 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:28.923742 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-69f50deb-5377-440c-83f3-3030deb24212 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:28.924549 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-69f50deb-5377-440c-83f3-3030deb24212 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:28.925225 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-69f50deb-5377-440c-83f3-3030deb24212 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:28.926056 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-69f50deb-5377-440c-83f3-3030deb24212 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:28.926723 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-69f50deb-5377-440c-83f3-3030deb24212 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:28.927351 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-69f50deb-5377-440c-83f3-3030deb24212 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:29.122611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2689ddff-1bcb-415a-8c2c-6ab316632941 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:29.125684 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-69f50deb-5377-440c-83f3-3030deb24212 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:29.132510 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2689ddff-1bcb-415a-8c2c-6ab316632941 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.257134 Sep 01 17:37:29.133088 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 57/128] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:28 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:29.136546 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-69f50deb-5377-440c-83f3-3030deb24212 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:29.138066 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-69f50deb-5377-440c-83f3-3030deb24212 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:29.140543 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-69f50deb-5377-440c-83f3-3030deb24212 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.229794 Sep 01 17:37:29.154105 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 72/129] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:28 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:29.639745 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-06614007-2c61-47ca-a813-d16480dc782b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:29.640582 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-06614007-2c61-47ca-a813-d16480dc782b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:29.646647 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06614007-2c61-47ca-a813-d16480dc782b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:29.647131 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06614007-2c61-47ca-a813-d16480dc782b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:29.647742 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06614007-2c61-47ca-a813-d16480dc782b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:29.648434 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06614007-2c61-47ca-a813-d16480dc782b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:29.648880 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06614007-2c61-47ca-a813-d16480dc782b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:29.649293 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06614007-2c61-47ca-a813-d16480dc782b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:30.016866 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-06614007-2c61-47ca-a813-d16480dc782b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:30.036274 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-06614007-2c61-47ca-a813-d16480dc782b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.402570 Sep 01 17:37:30.038653 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 58/130] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:29 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:30.165839 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-41ae7253-8067-4afb-a044-4a7b2557d5d0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:30.167222 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-41ae7253-8067-4afb-a044-4a7b2557d5d0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:30.169111 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f34da8f7-5f01-4dff-b9a7-208d0036601c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:30.169922 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f34da8f7-5f01-4dff-b9a7-208d0036601c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:30.178702 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-41ae7253-8067-4afb-a044-4a7b2557d5d0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:30.179115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-41ae7253-8067-4afb-a044-4a7b2557d5d0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:30.179554 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-41ae7253-8067-4afb-a044-4a7b2557d5d0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:30.180261 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-41ae7253-8067-4afb-a044-4a7b2557d5d0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:30.180718 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-41ae7253-8067-4afb-a044-4a7b2557d5d0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:30.181929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-41ae7253-8067-4afb-a044-4a7b2557d5d0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:30.188307 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f34da8f7-5f01-4dff-b9a7-208d0036601c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:30.188805 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f34da8f7-5f01-4dff-b9a7-208d0036601c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:30.189800 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f34da8f7-5f01-4dff-b9a7-208d0036601c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:30.191259 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f34da8f7-5f01-4dff-b9a7-208d0036601c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:30.192098 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f34da8f7-5f01-4dff-b9a7-208d0036601c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:30.194001 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f34da8f7-5f01-4dff-b9a7-208d0036601c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:30.408306 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-41ae7253-8067-4afb-a044-4a7b2557d5d0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:30.421935 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-41ae7253-8067-4afb-a044-4a7b2557d5d0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.269007 Sep 01 17:37:30.436187 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 73/131] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:30 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:30.541346 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f34da8f7-5f01-4dff-b9a7-208d0036601c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:30.553138 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f34da8f7-5f01-4dff-b9a7-208d0036601c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:30.556529 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f34da8f7-5f01-4dff-b9a7-208d0036601c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:30.558765 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f34da8f7-5f01-4dff-b9a7-208d0036601c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.396073 Sep 01 17:37:30.559958 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 59/132] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:30 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:37:31.062410 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-14d048df-9ae4-48c5-9c91-cc95c985a020 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:31.063304 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-14d048df-9ae4-48c5-9c91-cc95c985a020 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:31.073417 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-14d048df-9ae4-48c5-9c91-cc95c985a020 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:31.074197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-14d048df-9ae4-48c5-9c91-cc95c985a020 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:31.074820 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-14d048df-9ae4-48c5-9c91-cc95c985a020 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:31.075590 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-14d048df-9ae4-48c5-9c91-cc95c985a020 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:31.076044 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-14d048df-9ae4-48c5-9c91-cc95c985a020 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:31.076467 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-14d048df-9ae4-48c5-9c91-cc95c985a020 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:31.244118 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-14d048df-9ae4-48c5-9c91-cc95c985a020 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:31.252304 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-14d048df-9ae4-48c5-9c91-cc95c985a020 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.195034 Sep 01 17:37:31.258451 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 74/133] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:31 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:31.444212 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4cc1c9a6-2ad7-403c-a138-80baf7cf992b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:31.447756 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4cc1c9a6-2ad7-403c-a138-80baf7cf992b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:31.458924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4cc1c9a6-2ad7-403c-a138-80baf7cf992b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:31.460599 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4cc1c9a6-2ad7-403c-a138-80baf7cf992b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:31.462259 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4cc1c9a6-2ad7-403c-a138-80baf7cf992b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:31.464888 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4cc1c9a6-2ad7-403c-a138-80baf7cf992b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:31.479928 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4cc1c9a6-2ad7-403c-a138-80baf7cf992b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:31.480848 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4cc1c9a6-2ad7-403c-a138-80baf7cf992b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:31.589843 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d6af000c-efce-498c-a857-d28d15af09af tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:31.590904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d6af000c-efce-498c-a857-d28d15af09af tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:31.603383 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6af000c-efce-498c-a857-d28d15af09af tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:31.604166 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6af000c-efce-498c-a857-d28d15af09af tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:31.609741 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6af000c-efce-498c-a857-d28d15af09af tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:31.611106 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6af000c-efce-498c-a857-d28d15af09af tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:31.611652 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6af000c-efce-498c-a857-d28d15af09af tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:31.612179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6af000c-efce-498c-a857-d28d15af09af tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:31.778700 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4cc1c9a6-2ad7-403c-a138-80baf7cf992b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:31.794270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4cc1c9a6-2ad7-403c-a138-80baf7cf992b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.354424 Sep 01 17:37:31.796604 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 60/134] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:31 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:31.861199 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d6af000c-efce-498c-a857-d28d15af09af tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:31.863930 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:31.875830 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d6af000c-efce-498c-a857-d28d15af09af tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:31.877609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d6af000c-efce-498c-a857-d28d15af09af tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:31.878931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d6af000c-efce-498c-a857-d28d15af09af tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.297241 Sep 01 17:37:31.880020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 75/135] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:31 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:32.277259 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-547b6201-ec1a-4fae-9efb-4a69a2c8ae09 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:32.277259 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-547b6201-ec1a-4fae-9efb-4a69a2c8ae09 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:32.282366 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-547b6201-ec1a-4fae-9efb-4a69a2c8ae09 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:32.283407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-547b6201-ec1a-4fae-9efb-4a69a2c8ae09 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:32.283407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-547b6201-ec1a-4fae-9efb-4a69a2c8ae09 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:32.284375 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-547b6201-ec1a-4fae-9efb-4a69a2c8ae09 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:32.284751 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-547b6201-ec1a-4fae-9efb-4a69a2c8ae09 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:32.285347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-547b6201-ec1a-4fae-9efb-4a69a2c8ae09 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:32.500190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-547b6201-ec1a-4fae-9efb-4a69a2c8ae09 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:32.516733 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-547b6201-ec1a-4fae-9efb-4a69a2c8ae09 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.246886 Sep 01 17:37:32.523827 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 61/136] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:32 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:32.537886 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-a2b5239f-09e7-47c6-84e0-b645d4202454 req-34d45116-3ecd-4bfb-a934-5770fe17f9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab8419fc-b28b-4b08-9d93-85239477e211", "name": "network-vif-plugged", "status": "completed", "tag": "7d68e73f-e366-4e0c-baba-4fcb61d7ddcd"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:32.553506 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a2b5239f-09e7-47c6-84e0-b645d4202454 req-34d45116-3ecd-4bfb-a934-5770fe17f9b1 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:32.554109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a2b5239f-09e7-47c6-84e0-b645d4202454 req-34d45116-3ecd-4bfb-a934-5770fe17f9b1 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:32.560767 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a2b5239f-09e7-47c6-84e0-b645d4202454 req-34d45116-3ecd-4bfb-a934-5770fe17f9b1 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:32.607481 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-a2b5239f-09e7-47c6-84e0-b645d4202454 req-34d45116-3ecd-4bfb-a934-5770fe17f9b1 service nova] Creating event network-vif-plugged:7d68e73f-e366-4e0c-baba-4fcb61d7ddcd for instance ab8419fc-b28b-4b08-9d93-85239477e211 on hv-cinder-83976 Sep 01 17:37:32.617129 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-a2b5239f-09e7-47c6-84e0-b645d4202454 req-34d45116-3ecd-4bfb-a934-5770fe17f9b1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083703 Sep 01 17:37:32.620439 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 76/137] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:37:32.825234 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-142b07a4-39f1-4148-8c8c-7782854f6da5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:32.826304 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-142b07a4-39f1-4148-8c8c-7782854f6da5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:32.834827 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-142b07a4-39f1-4148-8c8c-7782854f6da5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:32.835647 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-142b07a4-39f1-4148-8c8c-7782854f6da5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:32.836225 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-142b07a4-39f1-4148-8c8c-7782854f6da5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:32.837797 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-142b07a4-39f1-4148-8c8c-7782854f6da5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:32.838708 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-142b07a4-39f1-4148-8c8c-7782854f6da5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:32.839223 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-142b07a4-39f1-4148-8c8c-7782854f6da5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:32.908760 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4fdd5318-8ec1-4b20-9caf-4472d7b86048 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:32.909752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4fdd5318-8ec1-4b20-9caf-4472d7b86048 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:32.920261 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4fdd5318-8ec1-4b20-9caf-4472d7b86048 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:32.920848 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4fdd5318-8ec1-4b20-9caf-4472d7b86048 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:32.921463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4fdd5318-8ec1-4b20-9caf-4472d7b86048 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:32.922375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4fdd5318-8ec1-4b20-9caf-4472d7b86048 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:32.922980 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4fdd5318-8ec1-4b20-9caf-4472d7b86048 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:32.923649 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4fdd5318-8ec1-4b20-9caf-4472d7b86048 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:33.108364 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-142b07a4-39f1-4148-8c8c-7782854f6da5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:33.124967 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-142b07a4-39f1-4148-8c8c-7782854f6da5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.305139 Sep 01 17:37:33.139968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 62/138] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:32 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:33.317078 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4fdd5318-8ec1-4b20-9caf-4472d7b86048 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:33.334221 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4fdd5318-8ec1-4b20-9caf-4472d7b86048 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:33.344119 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4fdd5318-8ec1-4b20-9caf-4472d7b86048 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:33.345364 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4fdd5318-8ec1-4b20-9caf-4472d7b86048 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.442330 Sep 01 17:37:33.347897 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 77/139] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:32 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:33.553043 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-eb66588d-c053-4f13-8f8e-96200c6824ec tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:33.553748 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-eb66588d-c053-4f13-8f8e-96200c6824ec tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:33.569756 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb66588d-c053-4f13-8f8e-96200c6824ec tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:33.570251 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb66588d-c053-4f13-8f8e-96200c6824ec tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:33.571657 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb66588d-c053-4f13-8f8e-96200c6824ec tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:33.572093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb66588d-c053-4f13-8f8e-96200c6824ec tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:33.572676 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb66588d-c053-4f13-8f8e-96200c6824ec tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:33.573113 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb66588d-c053-4f13-8f8e-96200c6824ec tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:33.807297 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-eb66588d-c053-4f13-8f8e-96200c6824ec tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:33.818568 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-eb66588d-c053-4f13-8f8e-96200c6824ec tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.271205 Sep 01 17:37:33.819327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 63/140] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:33 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:34.147757 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-bbbb5975-6aea-46e5-a0b6-992860ab1852 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:34.148619 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-bbbb5975-6aea-46e5-a0b6-992860ab1852 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:34.155863 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bbbb5975-6aea-46e5-a0b6-992860ab1852 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:34.156536 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bbbb5975-6aea-46e5-a0b6-992860ab1852 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:34.157155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bbbb5975-6aea-46e5-a0b6-992860ab1852 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:34.157903 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bbbb5975-6aea-46e5-a0b6-992860ab1852 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:34.158545 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bbbb5975-6aea-46e5-a0b6-992860ab1852 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:34.159159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bbbb5975-6aea-46e5-a0b6-992860ab1852 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:34.370688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9bd73712-de86-4148-85f3-ec386a0add5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:34.371285 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9bd73712-de86-4148-85f3-ec386a0add5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:34.376294 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:34.378335 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-bbbb5975-6aea-46e5-a0b6-992860ab1852 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:34.388067 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-bbbb5975-6aea-46e5-a0b6-992860ab1852 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.244615 Sep 01 17:37:34.397880 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9bd73712-de86-4148-85f3-ec386a0add5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:34.398053 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9bd73712-de86-4148-85f3-ec386a0add5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:34.398500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9bd73712-de86-4148-85f3-ec386a0add5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:34.402409 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9bd73712-de86-4148-85f3-ec386a0add5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:34.402409 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9bd73712-de86-4148-85f3-ec386a0add5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:34.402409 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9bd73712-de86-4148-85f3-ec386a0add5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:34.404449 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 78/141] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:34 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:34.657115 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9bd73712-de86-4148-85f3-ec386a0add5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:34.673406 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9bd73712-de86-4148-85f3-ec386a0add5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:34.679727 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9bd73712-de86-4148-85f3-ec386a0add5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:34.682558 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9bd73712-de86-4148-85f3-ec386a0add5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.316642 Sep 01 17:37:34.695454 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 64/142] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:34 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:34.849229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-345661ea-1848-48c5-a4ba-5d425b998d02 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:34.849677 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-345661ea-1848-48c5-a4ba-5d425b998d02 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:34.868628 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-345661ea-1848-48c5-a4ba-5d425b998d02 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:34.869654 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-345661ea-1848-48c5-a4ba-5d425b998d02 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:34.870262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-345661ea-1848-48c5-a4ba-5d425b998d02 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:34.871532 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-345661ea-1848-48c5-a4ba-5d425b998d02 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:34.875269 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-345661ea-1848-48c5-a4ba-5d425b998d02 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:34.875893 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-345661ea-1848-48c5-a4ba-5d425b998d02 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:35.134547 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-345661ea-1848-48c5-a4ba-5d425b998d02 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:35.150773 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-345661ea-1848-48c5-a4ba-5d425b998d02 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.304742 Sep 01 17:37:35.162475 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 79/143] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:34 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:35.414009 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6007da0a-8208-4666-99c8-c7a8d87abed1 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:35.415051 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6007da0a-8208-4666-99c8-c7a8d87abed1 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:35.438766 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6007da0a-8208-4666-99c8-c7a8d87abed1 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:35.439264 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6007da0a-8208-4666-99c8-c7a8d87abed1 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:35.439800 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6007da0a-8208-4666-99c8-c7a8d87abed1 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:35.440912 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6007da0a-8208-4666-99c8-c7a8d87abed1 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:35.441378 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6007da0a-8208-4666-99c8-c7a8d87abed1 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:35.441852 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6007da0a-8208-4666-99c8-c7a8d87abed1 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:35.637234 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6007da0a-8208-4666-99c8-c7a8d87abed1 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:35.646468 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6007da0a-8208-4666-99c8-c7a8d87abed1 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.237708 Sep 01 17:37:35.647053 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 65/144] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:35 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:35.710355 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b0ea3372-ed7e-47d8-87c5-6184e94ddc75 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:35.711066 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-b0ea3372-ed7e-47d8-87c5-6184e94ddc75 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:35.720277 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b0ea3372-ed7e-47d8-87c5-6184e94ddc75 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:35.721027 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b0ea3372-ed7e-47d8-87c5-6184e94ddc75 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:35.721478 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b0ea3372-ed7e-47d8-87c5-6184e94ddc75 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:35.722464 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b0ea3372-ed7e-47d8-87c5-6184e94ddc75 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:35.723523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b0ea3372-ed7e-47d8-87c5-6184e94ddc75 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:35.724169 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b0ea3372-ed7e-47d8-87c5-6184e94ddc75 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:35.940335 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b0ea3372-ed7e-47d8-87c5-6184e94ddc75 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:35.950682 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b0ea3372-ed7e-47d8-87c5-6184e94ddc75 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:35.952904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b0ea3372-ed7e-47d8-87c5-6184e94ddc75 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:35.954739 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-b0ea3372-ed7e-47d8-87c5-6184e94ddc75 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.249473 Sep 01 17:37:35.955905 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 80/145] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:35 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:37:36.175483 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d3760f10-2bb0-40fb-91d3-34e6e328bc9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:36.176986 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d3760f10-2bb0-40fb-91d3-34e6e328bc9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:36.186219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d3760f10-2bb0-40fb-91d3-34e6e328bc9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:36.187071 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d3760f10-2bb0-40fb-91d3-34e6e328bc9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:36.189958 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d3760f10-2bb0-40fb-91d3-34e6e328bc9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:36.191150 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d3760f10-2bb0-40fb-91d3-34e6e328bc9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:36.192108 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d3760f10-2bb0-40fb-91d3-34e6e328bc9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:36.192749 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d3760f10-2bb0-40fb-91d3-34e6e328bc9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:36.395435 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d3760f10-2bb0-40fb-91d3-34e6e328bc9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:36.422179 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d3760f10-2bb0-40fb-91d3-34e6e328bc9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.250763 Sep 01 17:37:36.427684 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 66/146] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:36 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:36.671613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-01e2e704-a249-499e-9e19-0ba4c742c21b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:36.672444 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-01e2e704-a249-499e-9e19-0ba4c742c21b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:36.679010 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-01e2e704-a249-499e-9e19-0ba4c742c21b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:36.679591 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-01e2e704-a249-499e-9e19-0ba4c742c21b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:36.680096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-01e2e704-a249-499e-9e19-0ba4c742c21b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:36.681726 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-01e2e704-a249-499e-9e19-0ba4c742c21b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:36.682890 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-01e2e704-a249-499e-9e19-0ba4c742c21b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:36.685152 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-01e2e704-a249-499e-9e19-0ba4c742c21b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:36.919329 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-01e2e704-a249-499e-9e19-0ba4c742c21b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:36.940497 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-01e2e704-a249-499e-9e19-0ba4c742c21b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.272600 Sep 01 17:37:36.941381 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 81/147] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:36 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:36.983227 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6eda5662-f600-420f-9f20-72588ef80c1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:36.985273 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6eda5662-f600-420f-9f20-72588ef80c1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:36.997755 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6eda5662-f600-420f-9f20-72588ef80c1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:36.998488 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6eda5662-f600-420f-9f20-72588ef80c1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:36.998928 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6eda5662-f600-420f-9f20-72588ef80c1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:36.999970 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6eda5662-f600-420f-9f20-72588ef80c1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:37.001452 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6eda5662-f600-420f-9f20-72588ef80c1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:37.002101 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6eda5662-f600-420f-9f20-72588ef80c1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:37.254782 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6eda5662-f600-420f-9f20-72588ef80c1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:37.268619 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6eda5662-f600-420f-9f20-72588ef80c1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:37.270939 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6eda5662-f600-420f-9f20-72588ef80c1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:37.273256 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6eda5662-f600-420f-9f20-72588ef80c1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.297898 Sep 01 17:37:37.274957 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 67/148] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:36 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:37:37.451819 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7f13d27c-e98e-4b15-be0b-957e4822ffb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:37.452830 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7f13d27c-e98e-4b15-be0b-957e4822ffb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:37.460500 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f13d27c-e98e-4b15-be0b-957e4822ffb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:37.460996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f13d27c-e98e-4b15-be0b-957e4822ffb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:37.461439 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f13d27c-e98e-4b15-be0b-957e4822ffb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:37.464970 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f13d27c-e98e-4b15-be0b-957e4822ffb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:37.466122 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f13d27c-e98e-4b15-be0b-957e4822ffb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:37.466442 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f13d27c-e98e-4b15-be0b-957e4822ffb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:37.670109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7f13d27c-e98e-4b15-be0b-957e4822ffb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:37.678584 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7f13d27c-e98e-4b15-be0b-957e4822ffb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.232623 Sep 01 17:37:37.679210 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 82/149] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:37 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:37.964732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d5d0f800-c840-4b0b-936c-e5324559224b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:37.965842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d5d0f800-c840-4b0b-936c-e5324559224b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:37.974548 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d5d0f800-c840-4b0b-936c-e5324559224b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:37.978626 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d5d0f800-c840-4b0b-936c-e5324559224b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:37.979201 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d5d0f800-c840-4b0b-936c-e5324559224b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:37.979810 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d5d0f800-c840-4b0b-936c-e5324559224b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:37.980270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d5d0f800-c840-4b0b-936c-e5324559224b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:37.980694 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d5d0f800-c840-4b0b-936c-e5324559224b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:38.140451 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d5d0f800-c840-4b0b-936c-e5324559224b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:38.149260 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d5d0f800-c840-4b0b-936c-e5324559224b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1318 microversion: 2.1 time: 0.189248 Sep 01 17:37:38.150356 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 68/150] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:37 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:38.301714 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-49fd667c-eba2-44de-815a-8d3205439dab tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:38.302327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-49fd667c-eba2-44de-815a-8d3205439dab tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:38.306320 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=80 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:38.318350 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-49fd667c-eba2-44de-815a-8d3205439dab tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:38.319281 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-49fd667c-eba2-44de-815a-8d3205439dab tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:38.319978 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-49fd667c-eba2-44de-815a-8d3205439dab tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:38.321493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-49fd667c-eba2-44de-815a-8d3205439dab tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:38.322187 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-49fd667c-eba2-44de-815a-8d3205439dab tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:38.322768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-49fd667c-eba2-44de-815a-8d3205439dab tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:38.517227 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-49fd667c-eba2-44de-815a-8d3205439dab tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:38.542545 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-49fd667c-eba2-44de-815a-8d3205439dab tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:38.543955 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-49fd667c-eba2-44de-815a-8d3205439dab tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:38.545092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-49fd667c-eba2-44de-815a-8d3205439dab tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.248825 Sep 01 17:37:38.545740 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 83/151] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:38 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:38.704134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f34cfe8e-3eb5-40e2-942c-d4215c92ef51 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:38.704923 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f34cfe8e-3eb5-40e2-942c-d4215c92ef51 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:38.711333 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=74 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:38.713628 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f34cfe8e-3eb5-40e2-942c-d4215c92ef51 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:38.714575 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f34cfe8e-3eb5-40e2-942c-d4215c92ef51 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:38.715250 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f34cfe8e-3eb5-40e2-942c-d4215c92ef51 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:38.716099 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f34cfe8e-3eb5-40e2-942c-d4215c92ef51 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:38.716706 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f34cfe8e-3eb5-40e2-942c-d4215c92ef51 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:38.717334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f34cfe8e-3eb5-40e2-942c-d4215c92ef51 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:38.892882 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f34cfe8e-3eb5-40e2-942c-d4215c92ef51 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:38.905660 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f34cfe8e-3eb5-40e2-942c-d4215c92ef51 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.206275 Sep 01 17:37:38.906255 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 69/152] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:38 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:39.171324 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-af5e5955-87ea-483f-8b17-eccd0a09461d req-b905b4e1-f0fa-4d20-9566-085fa0898690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc52ad3-09b3-4851-8a50-ad446bd1a75d", "name": "network-vif-plugged", "status": "completed", "tag": "be99e7bf-5f6d-42df-82e3-b77a04fd7684"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:39.173411 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-201c0afe-bd3f-4969-95d1-5839106b114d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:39.174328 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-201c0afe-bd3f-4969-95d1-5839106b114d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:39.187197 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-201c0afe-bd3f-4969-95d1-5839106b114d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:39.188104 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-201c0afe-bd3f-4969-95d1-5839106b114d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:39.191579 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-201c0afe-bd3f-4969-95d1-5839106b114d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:39.192629 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-201c0afe-bd3f-4969-95d1-5839106b114d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:39.193541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-af5e5955-87ea-483f-8b17-eccd0a09461d req-b905b4e1-f0fa-4d20-9566-085fa0898690 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:39.195247 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-af5e5955-87ea-483f-8b17-eccd0a09461d req-b905b4e1-f0fa-4d20-9566-085fa0898690 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:39.195708 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-201c0afe-bd3f-4969-95d1-5839106b114d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:39.198764 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-af5e5955-87ea-483f-8b17-eccd0a09461d req-b905b4e1-f0fa-4d20-9566-085fa0898690 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:39.203096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-201c0afe-bd3f-4969-95d1-5839106b114d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:39.224240 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-af5e5955-87ea-483f-8b17-eccd0a09461d req-b905b4e1-f0fa-4d20-9566-085fa0898690 service nova] Creating event network-vif-plugged:be99e7bf-5f6d-42df-82e3-b77a04fd7684 for instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d on hv-cinder-83976 Sep 01 17:37:39.238896 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-af5e5955-87ea-483f-8b17-eccd0a09461d req-b905b4e1-f0fa-4d20-9566-085fa0898690 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073087 Sep 01 17:37:39.239857 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 84/153] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:37:39.265787 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=100 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:39.425300 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-201c0afe-bd3f-4969-95d1-5839106b114d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:39.435677 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-201c0afe-bd3f-4969-95d1-5839106b114d tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1504 microversion: 2.1 time: 0.267359 Sep 01 17:37:39.437123 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 70/154] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:39 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:39.588971 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cbbdc84b-ec87-47bb-a7df-47f7d07a6a28 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:39.589748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cbbdc84b-ec87-47bb-a7df-47f7d07a6a28 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:39.613025 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cbbdc84b-ec87-47bb-a7df-47f7d07a6a28 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:39.614454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cbbdc84b-ec87-47bb-a7df-47f7d07a6a28 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:39.618928 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cbbdc84b-ec87-47bb-a7df-47f7d07a6a28 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:39.619776 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cbbdc84b-ec87-47bb-a7df-47f7d07a6a28 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:39.620246 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cbbdc84b-ec87-47bb-a7df-47f7d07a6a28 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:39.620669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cbbdc84b-ec87-47bb-a7df-47f7d07a6a28 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:39.932183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-524b2db6-e01b-482e-b7f6-14f351527ebd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:39.932944 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-524b2db6-e01b-482e-b7f6-14f351527ebd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:39.947665 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-524b2db6-e01b-482e-b7f6-14f351527ebd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:39.948677 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-524b2db6-e01b-482e-b7f6-14f351527ebd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:39.950336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-524b2db6-e01b-482e-b7f6-14f351527ebd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:39.951311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cbbdc84b-ec87-47bb-a7df-47f7d07a6a28 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:39.952850 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-524b2db6-e01b-482e-b7f6-14f351527ebd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:39.953762 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-524b2db6-e01b-482e-b7f6-14f351527ebd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:39.954447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-524b2db6-e01b-482e-b7f6-14f351527ebd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:39.962746 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cbbdc84b-ec87-47bb-a7df-47f7d07a6a28 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:39.972922 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cbbdc84b-ec87-47bb-a7df-47f7d07a6a28 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:39.974491 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cbbdc84b-ec87-47bb-a7df-47f7d07a6a28 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.390339 Sep 01 17:37:39.975531 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 85/155] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:39 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:40.327402 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-524b2db6-e01b-482e-b7f6-14f351527ebd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:40.347976 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-524b2db6-e01b-482e-b7f6-14f351527ebd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.422752 Sep 01 17:37:40.348863 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 71/156] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:39 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:41.016705 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-18718d6c-e95b-4a9e-b778-19508c25dcd2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:41.018534 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-18718d6c-e95b-4a9e-b778-19508c25dcd2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:41.026300 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18718d6c-e95b-4a9e-b778-19508c25dcd2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:41.026959 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18718d6c-e95b-4a9e-b778-19508c25dcd2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:41.027717 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18718d6c-e95b-4a9e-b778-19508c25dcd2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:41.028731 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18718d6c-e95b-4a9e-b778-19508c25dcd2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:41.029223 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18718d6c-e95b-4a9e-b778-19508c25dcd2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:41.029803 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18718d6c-e95b-4a9e-b778-19508c25dcd2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:41.305285 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-18718d6c-e95b-4a9e-b778-19508c25dcd2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:41.318626 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-18718d6c-e95b-4a9e-b778-19508c25dcd2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:41.320772 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-18718d6c-e95b-4a9e-b778-19508c25dcd2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:41.325534 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-18718d6c-e95b-4a9e-b778-19508c25dcd2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1411 microversion: 2.20 time: 0.312613 Sep 01 17:37:41.326712 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 86/157] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:41 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1411 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:41.378486 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-fb43c022-a869-4077-94e6-0f7816536056 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:41.379457 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-fb43c022-a869-4077-94e6-0f7816536056 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:41.390661 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb43c022-a869-4077-94e6-0f7816536056 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:41.391686 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb43c022-a869-4077-94e6-0f7816536056 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:41.393884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb43c022-a869-4077-94e6-0f7816536056 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:41.394688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb43c022-a869-4077-94e6-0f7816536056 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:41.395192 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb43c022-a869-4077-94e6-0f7816536056 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:41.395624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb43c022-a869-4077-94e6-0f7816536056 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:41.430744 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d49c8d85-c603-4436-bbbe-c05658f3b2c5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "733d06a5-fc88-4adf-8f75-0b5d99f21151"}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:41.433109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d49c8d85-c603-4436-bbbe-c05658f3b2c5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:41.460634 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d49c8d85-c603-4436-bbbe-c05658f3b2c5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:41.466405 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d49c8d85-c603-4436-bbbe-c05658f3b2c5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:41.466930 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d49c8d85-c603-4436-bbbe-c05658f3b2c5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:41.467672 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d49c8d85-c603-4436-bbbe-c05658f3b2c5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:41.468145 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d49c8d85-c603-4436-bbbe-c05658f3b2c5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:41.468600 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d49c8d85-c603-4436-bbbe-c05658f3b2c5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:41.695355 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-fb43c022-a869-4077-94e6-0f7816536056 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:41.714699 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-fb43c022-a869-4077-94e6-0f7816536056 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.342037 Sep 01 17:37:41.716184 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 72/158] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:41 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:42.308412 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d49c8d85-c603-4436-bbbe-c05658f3b2c5 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "POST /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881411 Sep 01 17:37:42.309675 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 87/159] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:37:41 2022] POST /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211/os-volume_attachments => generated 194 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:37:42.365969 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5d36b601-0688-42fa-b33e-9f96fc4bfe3b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:42.366573 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5d36b601-0688-42fa-b33e-9f96fc4bfe3b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:42.383457 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5d36b601-0688-42fa-b33e-9f96fc4bfe3b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:42.385380 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5d36b601-0688-42fa-b33e-9f96fc4bfe3b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:42.386003 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5d36b601-0688-42fa-b33e-9f96fc4bfe3b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:42.387043 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5d36b601-0688-42fa-b33e-9f96fc4bfe3b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:42.387649 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5d36b601-0688-42fa-b33e-9f96fc4bfe3b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:42.388941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5d36b601-0688-42fa-b33e-9f96fc4bfe3b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:42.588289 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5d36b601-0688-42fa-b33e-9f96fc4bfe3b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:42.597081 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5d36b601-0688-42fa-b33e-9f96fc4bfe3b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:42.598882 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5d36b601-0688-42fa-b33e-9f96fc4bfe3b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:42.600077 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5d36b601-0688-42fa-b33e-9f96fc4bfe3b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1603 microversion: 2.20 time: 0.239261 Sep 01 17:37:42.600637 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 73/160] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:42 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1603 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:42.629998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-00fe1cdf-fc80-4844-b9a1-bcdbf96ec085 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:42.632406 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-00fe1cdf-fc80-4844-b9a1-bcdbf96ec085 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:42.642055 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-00fe1cdf-fc80-4844-b9a1-bcdbf96ec085 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:42.642651 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-00fe1cdf-fc80-4844-b9a1-bcdbf96ec085 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:42.643152 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-00fe1cdf-fc80-4844-b9a1-bcdbf96ec085 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:42.644384 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-00fe1cdf-fc80-4844-b9a1-bcdbf96ec085 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:42.644921 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-00fe1cdf-fc80-4844-b9a1-bcdbf96ec085 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:42.645413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-00fe1cdf-fc80-4844-b9a1-bcdbf96ec085 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:42.739021 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-76f1538b-2fa6-44fe-9d60-170043a69c3d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:42.739999 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-76f1538b-2fa6-44fe-9d60-170043a69c3d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:42.758067 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-76f1538b-2fa6-44fe-9d60-170043a69c3d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:42.759476 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-76f1538b-2fa6-44fe-9d60-170043a69c3d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:42.760006 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-76f1538b-2fa6-44fe-9d60-170043a69c3d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:42.762277 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-76f1538b-2fa6-44fe-9d60-170043a69c3d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:42.773559 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-00fe1cdf-fc80-4844-b9a1-bcdbf96ec085 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.149351 Sep 01 17:37:42.776347 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 88/161] 10.222.0.100 () {60 vars in 1321 bytes} [Thu Sep 1 17:37:42 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:37:42.779916 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-76f1538b-2fa6-44fe-9d60-170043a69c3d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:42.780733 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-76f1538b-2fa6-44fe-9d60-170043a69c3d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:43.019784 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-76f1538b-2fa6-44fe-9d60-170043a69c3d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:43.036165 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-76f1538b-2fa6-44fe-9d60-170043a69c3d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.302055 Sep 01 17:37:43.039194 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 74/162] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:42 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:44.064901 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3e19df53-edbc-42c6-b7de-0e0471a133ad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:44.065837 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3e19df53-edbc-42c6-b7de-0e0471a133ad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:44.091537 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3e19df53-edbc-42c6-b7de-0e0471a133ad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:44.095115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3e19df53-edbc-42c6-b7de-0e0471a133ad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:44.097551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3e19df53-edbc-42c6-b7de-0e0471a133ad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:44.099019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3e19df53-edbc-42c6-b7de-0e0471a133ad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:44.099994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3e19df53-edbc-42c6-b7de-0e0471a133ad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:44.100677 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3e19df53-edbc-42c6-b7de-0e0471a133ad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:44.288855 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3e19df53-edbc-42c6-b7de-0e0471a133ad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:44.297920 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3e19df53-edbc-42c6-b7de-0e0471a133ad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.238914 Sep 01 17:37:44.299184 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 89/163] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:44 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:44.756895 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-d5e1387d-7724-4ea4-a39f-daa380ca925d req-012e2910-ef42-4b23-b970-4dcd8d172783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc52ad3-09b3-4851-8a50-ad446bd1a75d", "tag": "be99e7bf-5f6d-42df-82e3-b77a04fd7684"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:44.782457 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-d5e1387d-7724-4ea4-a39f-daa380ca925d req-012e2910-ef42-4b23-b970-4dcd8d172783 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:44.783026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-d5e1387d-7724-4ea4-a39f-daa380ca925d req-012e2910-ef42-4b23-b970-4dcd8d172783 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:44.783470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-d5e1387d-7724-4ea4-a39f-daa380ca925d req-012e2910-ef42-4b23-b970-4dcd8d172783 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:44.813452 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-d5e1387d-7724-4ea4-a39f-daa380ca925d req-012e2910-ef42-4b23-b970-4dcd8d172783 service nova] Creating event network-changed:be99e7bf-5f6d-42df-82e3-b77a04fd7684 for instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d on hv-cinder-83976 Sep 01 17:37:44.827592 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-d5e1387d-7724-4ea4-a39f-daa380ca925d req-012e2910-ef42-4b23-b970-4dcd8d172783 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073653 Sep 01 17:37:44.828235 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 75/164] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:37:45.325741 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7c280432-d3fd-4ffc-8368-4f82d49164c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:45.326371 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7c280432-d3fd-4ffc-8368-4f82d49164c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:45.334417 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7c280432-d3fd-4ffc-8368-4f82d49164c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:45.334915 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7c280432-d3fd-4ffc-8368-4f82d49164c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:45.335662 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7c280432-d3fd-4ffc-8368-4f82d49164c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:45.336446 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7c280432-d3fd-4ffc-8368-4f82d49164c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:45.336985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7c280432-d3fd-4ffc-8368-4f82d49164c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:45.338154 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7c280432-d3fd-4ffc-8368-4f82d49164c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:45.612202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7c280432-d3fd-4ffc-8368-4f82d49164c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:45.627929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7c280432-d3fd-4ffc-8368-4f82d49164c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.308291 Sep 01 17:37:45.637411 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 90/165] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:45 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:46.655373 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4c257ba9-e700-413f-aa2b-e43d459835f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:46.656086 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4c257ba9-e700-413f-aa2b-e43d459835f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:46.665909 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4c257ba9-e700-413f-aa2b-e43d459835f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:46.666401 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4c257ba9-e700-413f-aa2b-e43d459835f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:46.670650 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4c257ba9-e700-413f-aa2b-e43d459835f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:46.673487 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4c257ba9-e700-413f-aa2b-e43d459835f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:46.674354 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4c257ba9-e700-413f-aa2b-e43d459835f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:46.675028 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4c257ba9-e700-413f-aa2b-e43d459835f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:46.826984 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4c257ba9-e700-413f-aa2b-e43d459835f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:46.835244 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4c257ba9-e700-413f-aa2b-e43d459835f1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.189010 Sep 01 17:37:46.836127 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 76/166] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:46 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:47.862822 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-90c59dc9-b633-4a53-8aae-152f72e6924d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:47.863850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-90c59dc9-b633-4a53-8aae-152f72e6924d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:47.875772 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-90c59dc9-b633-4a53-8aae-152f72e6924d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:47.876597 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-90c59dc9-b633-4a53-8aae-152f72e6924d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:47.877253 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-90c59dc9-b633-4a53-8aae-152f72e6924d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:47.878468 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-90c59dc9-b633-4a53-8aae-152f72e6924d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:47.879730 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-90c59dc9-b633-4a53-8aae-152f72e6924d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:47.881304 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-90c59dc9-b633-4a53-8aae-152f72e6924d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:48.146131 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-90c59dc9-b633-4a53-8aae-152f72e6924d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:48.154741 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-90c59dc9-b633-4a53-8aae-152f72e6924d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.300602 Sep 01 17:37:48.155377 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 91/167] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:47 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:49.176419 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c729f789-0b56-491a-9251-845817ecdfd7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:49.177197 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c729f789-0b56-491a-9251-845817ecdfd7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:49.183977 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c729f789-0b56-491a-9251-845817ecdfd7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:49.184478 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c729f789-0b56-491a-9251-845817ecdfd7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:49.184913 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c729f789-0b56-491a-9251-845817ecdfd7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:49.186127 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c729f789-0b56-491a-9251-845817ecdfd7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:49.193840 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c729f789-0b56-491a-9251-845817ecdfd7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:49.193840 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c729f789-0b56-491a-9251-845817ecdfd7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:49.373183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c729f789-0b56-491a-9251-845817ecdfd7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:49.381519 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c729f789-0b56-491a-9251-845817ecdfd7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.209053 Sep 01 17:37:49.382182 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 77/168] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:49 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:50.403139 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-20e817cb-e9f8-44e3-8a77-54a61191b06e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:50.403749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-20e817cb-e9f8-44e3-8a77-54a61191b06e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:50.410881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-20e817cb-e9f8-44e3-8a77-54a61191b06e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:50.411414 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-20e817cb-e9f8-44e3-8a77-54a61191b06e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:50.412177 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-20e817cb-e9f8-44e3-8a77-54a61191b06e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:50.412889 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-20e817cb-e9f8-44e3-8a77-54a61191b06e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:50.413397 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-20e817cb-e9f8-44e3-8a77-54a61191b06e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:50.413863 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-20e817cb-e9f8-44e3-8a77-54a61191b06e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:50.610666 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-20e817cb-e9f8-44e3-8a77-54a61191b06e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:50.613525 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:50.620514 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-20e817cb-e9f8-44e3-8a77-54a61191b06e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.221459 Sep 01 17:37:50.621123 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 92/169] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:50 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:51.645458 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5e0f1c7c-81e4-4a49-bcd7-5c62d4bc46df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:51.647226 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5e0f1c7c-81e4-4a49-bcd7-5c62d4bc46df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:51.658614 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5e0f1c7c-81e4-4a49-bcd7-5c62d4bc46df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:51.662564 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5e0f1c7c-81e4-4a49-bcd7-5c62d4bc46df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:51.663215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5e0f1c7c-81e4-4a49-bcd7-5c62d4bc46df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:51.665040 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5e0f1c7c-81e4-4a49-bcd7-5c62d4bc46df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:51.673163 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5e0f1c7c-81e4-4a49-bcd7-5c62d4bc46df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:51.673838 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5e0f1c7c-81e4-4a49-bcd7-5c62d4bc46df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:51.833934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5e0f1c7c-81e4-4a49-bcd7-5c62d4bc46df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:51.843497 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5e0f1c7c-81e4-4a49-bcd7-5c62d4bc46df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.203122 Sep 01 17:37:51.844765 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 78/170] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:51 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:52.867337 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-430ed9e5-61e9-4f59-ae10-2c201e4e315b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:52.868570 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-430ed9e5-61e9-4f59-ae10-2c201e4e315b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:52.876236 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-430ed9e5-61e9-4f59-ae10-2c201e4e315b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:52.877079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-430ed9e5-61e9-4f59-ae10-2c201e4e315b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:52.877514 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-430ed9e5-61e9-4f59-ae10-2c201e4e315b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:52.878237 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-430ed9e5-61e9-4f59-ae10-2c201e4e315b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:52.878693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-430ed9e5-61e9-4f59-ae10-2c201e4e315b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:52.879114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-430ed9e5-61e9-4f59-ae10-2c201e4e315b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:53.034456 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-430ed9e5-61e9-4f59-ae10-2c201e4e315b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:53.044551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-430ed9e5-61e9-4f59-ae10-2c201e4e315b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.182392 Sep 01 17:37:53.045360 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 93/171] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:52 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:54.065399 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-18b8b4fb-0b72-4a49-b764-eeee6ae14e95 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:54.066155 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-18b8b4fb-0b72-4a49-b764-eeee6ae14e95 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:54.072398 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-18b8b4fb-0b72-4a49-b764-eeee6ae14e95 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:54.072960 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-18b8b4fb-0b72-4a49-b764-eeee6ae14e95 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:54.073455 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-18b8b4fb-0b72-4a49-b764-eeee6ae14e95 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:54.074248 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-18b8b4fb-0b72-4a49-b764-eeee6ae14e95 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:54.074788 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-18b8b4fb-0b72-4a49-b764-eeee6ae14e95 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:54.075271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-18b8b4fb-0b72-4a49-b764-eeee6ae14e95 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:54.217522 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-18b8b4fb-0b72-4a49-b764-eeee6ae14e95 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:54.225501 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-18b8b4fb-0b72-4a49-b764-eeee6ae14e95 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.163902 Sep 01 17:37:54.226112 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 79/172] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:54 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:55.249509 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-02ec30b5-c2f3-4083-ab30-0fcc17f2e41e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:55.250561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-02ec30b5-c2f3-4083-ab30-0fcc17f2e41e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:55.257858 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-02ec30b5-c2f3-4083-ab30-0fcc17f2e41e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:55.259092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-02ec30b5-c2f3-4083-ab30-0fcc17f2e41e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:55.259821 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-02ec30b5-c2f3-4083-ab30-0fcc17f2e41e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:55.260631 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-02ec30b5-c2f3-4083-ab30-0fcc17f2e41e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:55.261277 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-02ec30b5-c2f3-4083-ab30-0fcc17f2e41e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:55.261747 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-02ec30b5-c2f3-4083-ab30-0fcc17f2e41e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:55.432470 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-02ec30b5-c2f3-4083-ab30-0fcc17f2e41e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:55.440823 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-02ec30b5-c2f3-4083-ab30-0fcc17f2e41e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.195624 Sep 01 17:37:55.441412 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 94/173] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:55 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:55.676657 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1202529121", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "networks": [{"uuid": "bcc700fe-12c4-4b15-804f-2d8ef8a2dc7d"}]}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:55.736239 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.network.neutron [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] validate_networks() for [('bcc700fe-12c4-4b15-804f-2d8ef8a2dc7d', None, None, None, None, None)] {{(pid=127232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:37:56.431763 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Flavor limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:37:56.432332 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Image limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:37:56.432810 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Flavor pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:37:56.433393 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Image pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:37:56.434093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:37:56.444523 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:56.444998 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:56.445419 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:56.446236 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:56.446681 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:56.447088 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:56.466710 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8616d00d-4b5d-4631-b4d2-ccceb5842fad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:56.467306 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Getting quotas for project 356d731e34b24c9d8852516ae9141124. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:37:56.468026 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8616d00d-4b5d-4631-b4d2-ccceb5842fad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:56.472258 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Getting quotas for user 75de510214004bbeab187d65bf178735 and project 356d731e34b24c9d8852516ae9141124. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:37:56.483655 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8616d00d-4b5d-4631-b4d2-ccceb5842fad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:56.484151 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8616d00d-4b5d-4631-b4d2-ccceb5842fad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:56.484670 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8616d00d-4b5d-4631-b4d2-ccceb5842fad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:56.485367 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8616d00d-4b5d-4631-b4d2-ccceb5842fad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:56.485844 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8616d00d-4b5d-4631-b4d2-ccceb5842fad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:56.486260 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8616d00d-4b5d-4631-b4d2-ccceb5842fad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:56.490938 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Going to run 1 instances... {{(pid=127232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:37:56.494477 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:37:56.565712 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d1e96013-80df-47b2-8af0-2a922ef8eafd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.893709 Sep 01 17:37:56.566445 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 80/174] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:37:55 2022] POST /compute/v2.1/servers => generated 382 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:37:56.578224 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bb11e72e-7c00-4feb-b954-57445010f591 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:56.578838 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bb11e72e-7c00-4feb-b954-57445010f591 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:56.668053 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bb11e72e-7c00-4feb-b954-57445010f591 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:56.678142 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bb11e72e-7c00-4feb-b954-57445010f591 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1218 microversion: 2.1 time: 0.104411 Sep 01 17:37:56.679035 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 81/175] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:56 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:56.706929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8616d00d-4b5d-4631-b4d2-ccceb5842fad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:56.716551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8616d00d-4b5d-4631-b4d2-ccceb5842fad tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.256110 Sep 01 17:37:56.726677 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 95/176] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:56 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:57.700519 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-dcd1179c-463c-4633-b28a-97bf90c80b57 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:57.701164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-dcd1179c-463c-4633-b28a-97bf90c80b57 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:57.708501 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dcd1179c-463c-4633-b28a-97bf90c80b57 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:57.708983 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dcd1179c-463c-4633-b28a-97bf90c80b57 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:57.709422 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dcd1179c-463c-4633-b28a-97bf90c80b57 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:57.710149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dcd1179c-463c-4633-b28a-97bf90c80b57 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:57.710717 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dcd1179c-463c-4633-b28a-97bf90c80b57 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:57.711140 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dcd1179c-463c-4633-b28a-97bf90c80b57 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:57.739346 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8036feb0-e72d-4ac5-bd5a-c44d509b965c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:57.740109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8036feb0-e72d-4ac5-bd5a-c44d509b965c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:57.747137 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8036feb0-e72d-4ac5-bd5a-c44d509b965c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:57.747635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8036feb0-e72d-4ac5-bd5a-c44d509b965c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:57.748076 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8036feb0-e72d-4ac5-bd5a-c44d509b965c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:57.748989 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8036feb0-e72d-4ac5-bd5a-c44d509b965c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:57.749228 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8036feb0-e72d-4ac5-bd5a-c44d509b965c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:57.749688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8036feb0-e72d-4ac5-bd5a-c44d509b965c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:57.785804 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-dcd1179c-463c-4633-b28a-97bf90c80b57 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:57.794833 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-dcd1179c-463c-4633-b28a-97bf90c80b57 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1222 microversion: 2.1 time: 0.099042 Sep 01 17:37:57.795418 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 82/177] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:57 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:57.942058 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8036feb0-e72d-4ac5-bd5a-c44d509b965c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:57.950434 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8036feb0-e72d-4ac5-bd5a-c44d509b965c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.215064 Sep 01 17:37:57.951013 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 96/178] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:57 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:58.817054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-594dbe3b-e574-414c-ae95-6d248cce563a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:58.818391 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-594dbe3b-e574-414c-ae95-6d248cce563a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:58.825958 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-594dbe3b-e574-414c-ae95-6d248cce563a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:58.826446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-594dbe3b-e574-414c-ae95-6d248cce563a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:58.826881 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-594dbe3b-e574-414c-ae95-6d248cce563a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:58.827588 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-594dbe3b-e574-414c-ae95-6d248cce563a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:58.828042 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-594dbe3b-e574-414c-ae95-6d248cce563a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:58.828464 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-594dbe3b-e574-414c-ae95-6d248cce563a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:58.897559 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-594dbe3b-e574-414c-ae95-6d248cce563a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:58.907118 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-594dbe3b-e574-414c-ae95-6d248cce563a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1270 microversion: 2.1 time: 0.093680 Sep 01 17:37:58.907998 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 83/179] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:58 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:58.971383 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cf837609-47ce-47fd-8dfc-b85a5a7645f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:58.971988 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cf837609-47ce-47fd-8dfc-b85a5a7645f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:58.978957 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cf837609-47ce-47fd-8dfc-b85a5a7645f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:58.979448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cf837609-47ce-47fd-8dfc-b85a5a7645f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:58.979888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cf837609-47ce-47fd-8dfc-b85a5a7645f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:58.980587 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cf837609-47ce-47fd-8dfc-b85a5a7645f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:58.981041 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cf837609-47ce-47fd-8dfc-b85a5a7645f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:58.981467 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cf837609-47ce-47fd-8dfc-b85a5a7645f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:59.157042 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cf837609-47ce-47fd-8dfc-b85a5a7645f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:59.168620 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cf837609-47ce-47fd-8dfc-b85a5a7645f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.200164 Sep 01 17:37:59.169658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 97/180] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:58 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:59.193288 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-de7e005c-c2d6-4a55-a932-cbebdecdda1b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:59.194050 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-de7e005c-c2d6-4a55-a932-cbebdecdda1b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:59.201024 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-de7e005c-c2d6-4a55-a932-cbebdecdda1b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:59.201493 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-de7e005c-c2d6-4a55-a932-cbebdecdda1b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:59.201963 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-de7e005c-c2d6-4a55-a932-cbebdecdda1b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:59.202652 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-de7e005c-c2d6-4a55-a932-cbebdecdda1b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:59.203092 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-de7e005c-c2d6-4a55-a932-cbebdecdda1b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:59.203502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-de7e005c-c2d6-4a55-a932-cbebdecdda1b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:59.229097 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-de7e005c-c2d6-4a55-a932-cbebdecdda1b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Going to try to terminate instance {{(pid=127232) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:37:59.386527 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-de7e005c-c2d6-4a55-a932-cbebdecdda1b tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 204 len: 0 microversion: 2.1 time: 0.195692 Sep 01 17:37:59.387153 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 84/181] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:37:59 2022] DELETE /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:37:59.396249 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0650a17c-c178-481e-bfc6-6f7b01f25da2 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:59.396869 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0650a17c-c178-481e-bfc6-6f7b01f25da2 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:59.403111 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0650a17c-c178-481e-bfc6-6f7b01f25da2 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:59.403598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0650a17c-c178-481e-bfc6-6f7b01f25da2 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:59.404039 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0650a17c-c178-481e-bfc6-6f7b01f25da2 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:59.404742 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0650a17c-c178-481e-bfc6-6f7b01f25da2 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:59.405200 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0650a17c-c178-481e-bfc6-6f7b01f25da2 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:59.406360 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0650a17c-c178-481e-bfc6-6f7b01f25da2 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:59.556306 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0650a17c-c178-481e-bfc6-6f7b01f25da2 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:59.565768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0650a17c-c178-481e-bfc6-6f7b01f25da2 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1556 microversion: 2.1 time: 0.173579 Sep 01 17:37:59.566348 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 98/182] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:59 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:59.928785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9a7f71ca-5c59-4076-aeca-44639916e03c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:59.929481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9a7f71ca-5c59-4076-aeca-44639916e03c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:59.935883 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a7f71ca-5c59-4076-aeca-44639916e03c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:59.936374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a7f71ca-5c59-4076-aeca-44639916e03c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:59.936814 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a7f71ca-5c59-4076-aeca-44639916e03c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:59.937500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a7f71ca-5c59-4076-aeca-44639916e03c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:59.937976 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a7f71ca-5c59-4076-aeca-44639916e03c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:59.938398 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a7f71ca-5c59-4076-aeca-44639916e03c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:00.014452 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9a7f71ca-5c59-4076-aeca-44639916e03c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:00.023184 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9a7f71ca-5c59-4076-aeca-44639916e03c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1278 microversion: 2.1 time: 0.098471 Sep 01 17:38:00.024287 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 85/183] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:59 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1278 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:00.192543 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-04159a65-934f-49de-b7b9-7b78e39f63bf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:00.193147 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-04159a65-934f-49de-b7b9-7b78e39f63bf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:00.199852 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-04159a65-934f-49de-b7b9-7b78e39f63bf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:00.200329 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-04159a65-934f-49de-b7b9-7b78e39f63bf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:00.200755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-04159a65-934f-49de-b7b9-7b78e39f63bf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:00.201433 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-04159a65-934f-49de-b7b9-7b78e39f63bf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:00.201915 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-04159a65-934f-49de-b7b9-7b78e39f63bf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:00.202328 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-04159a65-934f-49de-b7b9-7b78e39f63bf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:00.334682 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-04159a65-934f-49de-b7b9-7b78e39f63bf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:00.342506 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-04159a65-934f-49de-b7b9-7b78e39f63bf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.154289 Sep 01 17:38:00.343075 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 99/184] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:00 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:00.587322 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a2beaddb-b6d5-4990-b8a2-50fae71c4c23 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:00.588306 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a2beaddb-b6d5-4990-b8a2-50fae71c4c23 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:00.595365 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a2beaddb-b6d5-4990-b8a2-50fae71c4c23 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:00.595909 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a2beaddb-b6d5-4990-b8a2-50fae71c4c23 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:00.596779 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a2beaddb-b6d5-4990-b8a2-50fae71c4c23 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:00.603483 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a2beaddb-b6d5-4990-b8a2-50fae71c4c23 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:00.603968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a2beaddb-b6d5-4990-b8a2-50fae71c4c23 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:00.604409 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a2beaddb-b6d5-4990-b8a2-50fae71c4c23 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:00.755848 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a2beaddb-b6d5-4990-b8a2-50fae71c4c23 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:00.766194 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a2beaddb-b6d5-4990-b8a2-50fae71c4c23 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1556 microversion: 2.1 time: 0.183324 Sep 01 17:38:00.766881 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 86/185] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:00 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1556 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:01.047324 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c97b3292-8a69-4eeb-802e-8be921cfd77f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:01.048039 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c97b3292-8a69-4eeb-802e-8be921cfd77f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:01.054209 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c97b3292-8a69-4eeb-802e-8be921cfd77f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:01.054698 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c97b3292-8a69-4eeb-802e-8be921cfd77f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:01.055147 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c97b3292-8a69-4eeb-802e-8be921cfd77f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:01.056506 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c97b3292-8a69-4eeb-802e-8be921cfd77f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:01.057163 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c97b3292-8a69-4eeb-802e-8be921cfd77f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:01.057643 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c97b3292-8a69-4eeb-802e-8be921cfd77f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:01.137371 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c97b3292-8a69-4eeb-802e-8be921cfd77f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:01.147960 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-c97b3292-8a69-4eeb-802e-8be921cfd77f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1278 microversion: 2.1 time: 0.104583 Sep 01 17:38:01.149259 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 100/186] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:01 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:01.364120 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-abbe04a2-3fde-40ef-bee0-124374b8f293 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:01.364737 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-abbe04a2-3fde-40ef-bee0-124374b8f293 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:01.382541 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-abbe04a2-3fde-40ef-bee0-124374b8f293 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:01.384516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-abbe04a2-3fde-40ef-bee0-124374b8f293 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:01.385490 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-abbe04a2-3fde-40ef-bee0-124374b8f293 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:01.386712 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-abbe04a2-3fde-40ef-bee0-124374b8f293 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:01.387320 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-abbe04a2-3fde-40ef-bee0-124374b8f293 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:01.387931 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-abbe04a2-3fde-40ef-bee0-124374b8f293 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:01.584029 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-abbe04a2-3fde-40ef-bee0-124374b8f293 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:01.589342 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:01.595103 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-abbe04a2-3fde-40ef-bee0-124374b8f293 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.234959 Sep 01 17:38:01.606505 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 87/187] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:01 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:01.788355 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ecc18a48-b879-4e78-ab2f-d516ac23f9a0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:01.789608 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ecc18a48-b879-4e78-ab2f-d516ac23f9a0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:01.799422 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ecc18a48-b879-4e78-ab2f-d516ac23f9a0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:01.802906 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ecc18a48-b879-4e78-ab2f-d516ac23f9a0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:01.803731 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ecc18a48-b879-4e78-ab2f-d516ac23f9a0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:01.806192 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ecc18a48-b879-4e78-ab2f-d516ac23f9a0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:01.807052 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ecc18a48-b879-4e78-ab2f-d516ac23f9a0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:01.808423 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ecc18a48-b879-4e78-ab2f-d516ac23f9a0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:02.016468 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ecc18a48-b879-4e78-ab2f-d516ac23f9a0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:02.027474 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ecc18a48-b879-4e78-ab2f-d516ac23f9a0 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1556 microversion: 2.1 time: 0.243042 Sep 01 17:38:02.028421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 101/188] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:01 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1556 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:02.176138 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-fdb017f8-3d9a-4c66-85ef-3020666a372f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:02.177122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-fdb017f8-3d9a-4c66-85ef-3020666a372f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:02.187582 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fdb017f8-3d9a-4c66-85ef-3020666a372f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:02.188807 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fdb017f8-3d9a-4c66-85ef-3020666a372f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:02.189724 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fdb017f8-3d9a-4c66-85ef-3020666a372f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:02.190765 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fdb017f8-3d9a-4c66-85ef-3020666a372f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:02.191548 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fdb017f8-3d9a-4c66-85ef-3020666a372f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:02.192169 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fdb017f8-3d9a-4c66-85ef-3020666a372f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:02.408652 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-fdb017f8-3d9a-4c66-85ef-3020666a372f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:02.431867 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-fdb017f8-3d9a-4c66-85ef-3020666a372f tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1318 microversion: 2.1 time: 0.262128 Sep 01 17:38:02.434675 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 88/189] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:02 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:02.616633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7bcba67d-9eea-4f6f-b5e8-a90dd01386e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:02.619051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7bcba67d-9eea-4f6f-b5e8-a90dd01386e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:02.626641 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7bcba67d-9eea-4f6f-b5e8-a90dd01386e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:02.627324 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7bcba67d-9eea-4f6f-b5e8-a90dd01386e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:02.627923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7bcba67d-9eea-4f6f-b5e8-a90dd01386e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:02.628909 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7bcba67d-9eea-4f6f-b5e8-a90dd01386e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:02.629737 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7bcba67d-9eea-4f6f-b5e8-a90dd01386e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:02.630339 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7bcba67d-9eea-4f6f-b5e8-a90dd01386e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:03.057703 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7bcba67d-9eea-4f6f-b5e8-a90dd01386e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:03.059395 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-fd554cd3-05fa-4fc8-9fbb-f90d1cab3139 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:03.060840 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-fd554cd3-05fa-4fc8-9fbb-f90d1cab3139 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:03.086292 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fd554cd3-05fa-4fc8-9fbb-f90d1cab3139 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:03.089101 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fd554cd3-05fa-4fc8-9fbb-f90d1cab3139 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:03.094171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fd554cd3-05fa-4fc8-9fbb-f90d1cab3139 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:03.096005 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7bcba67d-9eea-4f6f-b5e8-a90dd01386e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.483190 Sep 01 17:38:03.097714 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fd554cd3-05fa-4fc8-9fbb-f90d1cab3139 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:03.098779 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fd554cd3-05fa-4fc8-9fbb-f90d1cab3139 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:03.099461 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 102/190] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:02 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:03.105296 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fd554cd3-05fa-4fc8-9fbb-f90d1cab3139 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:03.116752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-4373f673-5796-433a-9bf1-ec2e7b3ed23d req-add1eb82-9c30-4cb6-843e-f04d329fa26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab8419fc-b28b-4b08-9d93-85239477e211", "name": "network-vif-deleted", "tag": "7d68e73f-e366-4e0c-baba-4fcb61d7ddcd"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:03.151780 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-4373f673-5796-433a-9bf1-ec2e7b3ed23d req-add1eb82-9c30-4cb6-843e-f04d329fa26c service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:03.152523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-4373f673-5796-433a-9bf1-ec2e7b3ed23d req-add1eb82-9c30-4cb6-843e-f04d329fa26c service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:03.154857 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-4373f673-5796-433a-9bf1-ec2e7b3ed23d req-add1eb82-9c30-4cb6-843e-f04d329fa26c service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:03.199334 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-4373f673-5796-433a-9bf1-ec2e7b3ed23d req-add1eb82-9c30-4cb6-843e-f04d329fa26c service nova] Creating event network-vif-deleted:7d68e73f-e366-4e0c-baba-4fcb61d7ddcd for instance ab8419fc-b28b-4b08-9d93-85239477e211 on hv-cinder-83976 Sep 01 17:38:03.208680 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-4373f673-5796-433a-9bf1-ec2e7b3ed23d req-add1eb82-9c30-4cb6-843e-f04d329fa26c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104313 Sep 01 17:38:03.210259 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 103/191] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:03.317252 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-fd554cd3-05fa-4fc8-9fbb-f90d1cab3139 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:03.327824 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-fd554cd3-05fa-4fc8-9fbb-f90d1cab3139 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1349 microversion: 2.1 time: 0.280802 Sep 01 17:38:03.329073 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 89/192] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:03 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1349 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:03.457373 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3ab97dac-38d7-46c0-b51f-854f8507c621 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:03.458410 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3ab97dac-38d7-46c0-b51f-854f8507c621 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:03.469878 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3ab97dac-38d7-46c0-b51f-854f8507c621 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:03.470644 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3ab97dac-38d7-46c0-b51f-854f8507c621 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:03.471229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3ab97dac-38d7-46c0-b51f-854f8507c621 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:03.472452 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3ab97dac-38d7-46c0-b51f-854f8507c621 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:03.473098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3ab97dac-38d7-46c0-b51f-854f8507c621 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:03.473706 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3ab97dac-38d7-46c0-b51f-854f8507c621 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:03.679958 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3ab97dac-38d7-46c0-b51f-854f8507c621 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:03.690527 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3ab97dac-38d7-46c0-b51f-854f8507c621 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1318 microversion: 2.1 time: 0.238314 Sep 01 17:38:03.691353 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 104/193] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:03 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:04.124271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-85fe6ddb-967d-4734-9401-a085cb36de29 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:04.125028 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-85fe6ddb-967d-4734-9401-a085cb36de29 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:04.134474 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85fe6ddb-967d-4734-9401-a085cb36de29 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:04.135183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85fe6ddb-967d-4734-9401-a085cb36de29 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:04.136222 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85fe6ddb-967d-4734-9401-a085cb36de29 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:04.137113 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85fe6ddb-967d-4734-9401-a085cb36de29 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:04.137837 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85fe6ddb-967d-4734-9401-a085cb36de29 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:04.139008 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85fe6ddb-967d-4734-9401-a085cb36de29 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:04.351986 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:04.354749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:04.367492 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:04.369038 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:04.369750 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:04.370694 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:04.371380 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:04.372202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:04.390796 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-85fe6ddb-967d-4734-9401-a085cb36de29 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:04.401390 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-85fe6ddb-967d-4734-9401-a085cb36de29 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.282849 Sep 01 17:38:04.405640 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 90/194] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:04 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:04.452890 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:04.453500 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:04.453978 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:04.456706 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lazy-loading 'fault' on Instance uuid ab8419fc-b28b-4b08-9d93-85239477e211 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:04.539764 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:04.550899 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-fe700a0d-aa53-4c46-8958-c5f27ae1f71a tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1354 microversion: 2.1 time: 0.205946 Sep 01 17:38:04.552013 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 105/195] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:04 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1354 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:04.713372 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4ef9aa51-9bf4-404c-8cf9-67bf00f08e22 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:04.714427 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4ef9aa51-9bf4-404c-8cf9-67bf00f08e22 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:04.720761 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4ef9aa51-9bf4-404c-8cf9-67bf00f08e22 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:04.721722 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4ef9aa51-9bf4-404c-8cf9-67bf00f08e22 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:04.722221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4ef9aa51-9bf4-404c-8cf9-67bf00f08e22 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:04.722933 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4ef9aa51-9bf4-404c-8cf9-67bf00f08e22 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:04.723386 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4ef9aa51-9bf4-404c-8cf9-67bf00f08e22 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:04.723868 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4ef9aa51-9bf4-404c-8cf9-67bf00f08e22 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:04.901599 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4ef9aa51-9bf4-404c-8cf9-67bf00f08e22 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:04.917698 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4ef9aa51-9bf4-404c-8cf9-67bf00f08e22 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1318 microversion: 2.1 time: 0.208629 Sep 01 17:38:04.919371 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 91/196] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:04 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:05.244401 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-05086f79-d023-4509-bd2d-c23f24ed1f6c req-62288b78-de16-4c8f-be53-a69f4bc744b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f95fb669-aa1f-43d4-af34-44437825c6e6", "tag": "02ec5ddb-bbdf-4e77-9dba-4c030c16cba2"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:05.259969 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-05086f79-d023-4509-bd2d-c23f24ed1f6c req-62288b78-de16-4c8f-be53-a69f4bc744b5 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:05.260459 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-05086f79-d023-4509-bd2d-c23f24ed1f6c req-62288b78-de16-4c8f-be53-a69f4bc744b5 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:05.260884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-05086f79-d023-4509-bd2d-c23f24ed1f6c req-62288b78-de16-4c8f-be53-a69f4bc744b5 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:05.277199 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-05086f79-d023-4509-bd2d-c23f24ed1f6c req-62288b78-de16-4c8f-be53-a69f4bc744b5 service nova] Creating event network-changed:02ec5ddb-bbdf-4e77-9dba-4c030c16cba2 for instance f95fb669-aa1f-43d4-af34-44437825c6e6 on hv-cinder-83976 Sep 01 17:38:05.282232 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-05086f79-d023-4509-bd2d-c23f24ed1f6c req-62288b78-de16-4c8f-be53-a69f4bc744b5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043674 Sep 01 17:38:05.282843 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 106/197] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:05.430583 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a34d27bc-9191-4671-8154-752b556d3bf9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:05.431312 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a34d27bc-9191-4671-8154-752b556d3bf9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:05.437170 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a34d27bc-9191-4671-8154-752b556d3bf9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:05.437692 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a34d27bc-9191-4671-8154-752b556d3bf9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:05.438301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a34d27bc-9191-4671-8154-752b556d3bf9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:05.439181 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a34d27bc-9191-4671-8154-752b556d3bf9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:05.439877 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a34d27bc-9191-4671-8154-752b556d3bf9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:05.440234 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a34d27bc-9191-4671-8154-752b556d3bf9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:05.577076 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:05.577936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:05.588828 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:05.589599 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:05.591084 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:05.592693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:05.593376 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:05.594045 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:05.603132 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a34d27bc-9191-4671-8154-752b556d3bf9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:05.611777 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a34d27bc-9191-4671-8154-752b556d3bf9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.184923 Sep 01 17:38:05.612351 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 92/198] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:05 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:05.646700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:05.647552 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:05.648722 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:05.650300 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lazy-loading 'fault' on Instance uuid ab8419fc-b28b-4b08-9d93-85239477e211 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:05.709191 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:05.721072 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-52ca1d4e-ecbc-4ca5-b865-5d1b1b223513 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1354 microversion: 2.1 time: 0.149875 Sep 01 17:38:05.736011 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 107/199] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:05 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1354 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:05.943826 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-31965cca-2782-4f50-8a83-6cdbf226bcf1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:05.944437 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-31965cca-2782-4f50-8a83-6cdbf226bcf1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:05.951953 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31965cca-2782-4f50-8a83-6cdbf226bcf1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:05.952368 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31965cca-2782-4f50-8a83-6cdbf226bcf1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:05.952805 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31965cca-2782-4f50-8a83-6cdbf226bcf1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:05.953505 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31965cca-2782-4f50-8a83-6cdbf226bcf1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:05.954664 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31965cca-2782-4f50-8a83-6cdbf226bcf1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:05.955406 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31965cca-2782-4f50-8a83-6cdbf226bcf1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:06.131291 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-31965cca-2782-4f50-8a83-6cdbf226bcf1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:06.141059 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-31965cca-2782-4f50-8a83-6cdbf226bcf1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1318 microversion: 2.1 time: 0.203728 Sep 01 17:38:06.141661 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 93/200] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:05 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:06.633621 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-054f04f3-25b8-4e20-9102-0f366871157a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:06.633621 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-054f04f3-25b8-4e20-9102-0f366871157a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:06.640030 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-054f04f3-25b8-4e20-9102-0f366871157a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:06.640525 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-054f04f3-25b8-4e20-9102-0f366871157a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:06.640966 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-054f04f3-25b8-4e20-9102-0f366871157a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:06.641699 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-054f04f3-25b8-4e20-9102-0f366871157a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:06.642334 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-054f04f3-25b8-4e20-9102-0f366871157a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:06.642770 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-054f04f3-25b8-4e20-9102-0f366871157a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:06.746017 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:06.748327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:06.750439 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:06.752293 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=8 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:06.760361 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:06.761076 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:06.762006 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:06.762959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:06.763833 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:06.764270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:06.812419 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:06.812970 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:06.813523 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:06.813893 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lazy-loading 'fault' on Instance uuid ab8419fc-b28b-4b08-9d93-85239477e211 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:06.814599 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-054f04f3-25b8-4e20-9102-0f366871157a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:06.824110 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-054f04f3-25b8-4e20-9102-0f366871157a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.195641 Sep 01 17:38:06.824713 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 108/201] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:06 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:06.868351 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:06.879161 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-04d302c8-1d82-4dae-b978-e19eeeb6d457 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1354 microversion: 2.1 time: 0.139197 Sep 01 17:38:06.884221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 94/202] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:06 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:07.163602 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8c27bd2c-64db-4fe9-962a-cf0095cb4d46 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:07.164208 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8c27bd2c-64db-4fe9-962a-cf0095cb4d46 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:07.171549 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c27bd2c-64db-4fe9-962a-cf0095cb4d46 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:07.172219 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c27bd2c-64db-4fe9-962a-cf0095cb4d46 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:07.172643 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c27bd2c-64db-4fe9-962a-cf0095cb4d46 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:07.173515 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c27bd2c-64db-4fe9-962a-cf0095cb4d46 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:07.174195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c27bd2c-64db-4fe9-962a-cf0095cb4d46 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:07.174795 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c27bd2c-64db-4fe9-962a-cf0095cb4d46 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:07.330595 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8c27bd2c-64db-4fe9-962a-cf0095cb4d46 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:07.341949 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8c27bd2c-64db-4fe9-962a-cf0095cb4d46 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1318 microversion: 2.1 time: 0.182748 Sep 01 17:38:07.346196 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 109/203] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:07 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:07.845585 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b97a3fc6-b2d7-4376-b18f-f3a680753f3b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:07.846302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b97a3fc6-b2d7-4376-b18f-f3a680753f3b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:07.852313 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b97a3fc6-b2d7-4376-b18f-f3a680753f3b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:07.853387 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b97a3fc6-b2d7-4376-b18f-f3a680753f3b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:07.853873 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b97a3fc6-b2d7-4376-b18f-f3a680753f3b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:07.854632 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b97a3fc6-b2d7-4376-b18f-f3a680753f3b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:07.855086 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b97a3fc6-b2d7-4376-b18f-f3a680753f3b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:07.855507 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b97a3fc6-b2d7-4376-b18f-f3a680753f3b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:07.901108 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:07.902511 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:07.910565 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:07.911235 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:07.912162 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:07.913025 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:07.913665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:07.914231 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:07.919645 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=100 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:07.981614 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:07.982511 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:07.983227 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:07.983821 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lazy-loading 'fault' on Instance uuid ab8419fc-b28b-4b08-9d93-85239477e211 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:08.051869 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcea72e4fc77431a96e7acf9d68eb083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3925a7fb6c4d099c4f160d42870a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:08.069539 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-57669a27-8d6e-4dac-8370-d5345e362b22 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 200 len: 1354 microversion: 2.1 time: 0.172891 Sep 01 17:38:08.070161 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 110/204] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:07 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 1354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:08.108868 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b97a3fc6-b2d7-4376-b18f-f3a680753f3b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:08.123383 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b97a3fc6-b2d7-4376-b18f-f3a680753f3b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.281474 Sep 01 17:38:08.124578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 95/205] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:07 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:08.364642 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0646bf71-f5d1-45d7-987c-82a3891c3a99 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:08.365814 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0646bf71-f5d1-45d7-987c-82a3891c3a99 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:08.369882 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=62 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:08.374491 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0646bf71-f5d1-45d7-987c-82a3891c3a99 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:08.375431 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0646bf71-f5d1-45d7-987c-82a3891c3a99 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:08.376104 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0646bf71-f5d1-45d7-987c-82a3891c3a99 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:08.377006 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0646bf71-f5d1-45d7-987c-82a3891c3a99 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:08.377702 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0646bf71-f5d1-45d7-987c-82a3891c3a99 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:08.378326 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0646bf71-f5d1-45d7-987c-82a3891c3a99 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:08.564431 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-228131278", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:08.572719 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0646bf71-f5d1-45d7-987c-82a3891c3a99 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:08.582011 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0646bf71-f5d1-45d7-987c-82a3891c3a99 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1318 microversion: 2.1 time: 0.222922 Sep 01 17:38:08.583246 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 111/206] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:08 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:08.627438 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.network.neutron [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] validate_networks() for None {{(pid=127232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:38:08.997987 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Flavor limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:38:08.999116 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Image limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:38:08.999826 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Flavor pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:38:09.000457 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Image pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:38:09.001083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:38:09.009623 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:09.027725 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.028607 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.030463 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.032288 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.033209 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.034135 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.055041 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Getting quotas for project 8643f179145e4e1aba7994ada9821a30. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:38:09.060585 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Getting quotas for user c2e0a450471043678b080515896d0f50 and project 8643f179145e4e1aba7994ada9821a30. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:38:09.074826 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Going to run 1 instances... {{(pid=127232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:38:09.077714 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:38:09.090905 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-57f4ac2b-2be9-46ba-9b3a-1f5dff7ce45c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:09.092167 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-57f4ac2b-2be9-46ba-9b3a-1f5dff7ce45c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:09.099434 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57f4ac2b-2be9-46ba-9b3a-1f5dff7ce45c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.100674 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57f4ac2b-2be9-46ba-9b3a-1f5dff7ce45c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.101402 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57f4ac2b-2be9-46ba-9b3a-1f5dff7ce45c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.103077 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57f4ac2b-2be9-46ba-9b3a-1f5dff7ce45c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.103638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57f4ac2b-2be9-46ba-9b3a-1f5dff7ce45c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.104278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-57f4ac2b-2be9-46ba-9b3a-1f5dff7ce45c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.135374 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-57f4ac2b-2be9-46ba-9b3a-1f5dff7ce45c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] HTTP exception thrown: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:09.138937 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b740d3b4-5587-48c8-a9bd-4cdc09b0003a tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.578491 Sep 01 17:38:09.139590 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 96/207] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:38:08 2022] POST /compute/v2.1/servers => generated 382 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 01 17:38:09.145918 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ef13577a-71e7-4bb5-a937-88e6c4c5c058 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:09.146752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ef13577a-71e7-4bb5-a937-88e6c4c5c058 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-57f4ac2b-2be9-46ba-9b3a-1f5dff7ce45c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Request method failure captured: Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 HTTP/1.1 Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2rV_OGsNArr36VJ1rcbsKezghLrMBZLU2-U9_mLsTbTSqUyJ3NilAabNHGS_UHrn-BHWI_ZDU-etqiDFEF_LDkLlqkcqXFczZ_D3rJOG5DTPWCWYXzp0Cg8yoMkdjtCxZBbKQ8plseNKsXjGlJx_CocfMU_nsjA_NHUroQhbIiAOA Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: df3925a7fb6c4d099c4f160d42870a3b Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-DeleteServersTestJSON-2110766679 Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:38:09.148103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:38:09.150115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:38:09.150115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-DeleteServersTestJSON-2110766679 Sep 01 17:38:09.150115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: df3925a7fb6c4d099c4f160d42870a3b Sep 01 17:38:09.150115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-DeleteServersTestJSON-2110766679 Sep 01 17:38:09.150115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-DeleteServersTestJSON-2110766679-project Sep 01 17:38:09.150115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:38:09.150115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:38:09.150115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: bcea72e4fc77431a96e7acf9d68eb083 Sep 01 17:38:09.150115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-DeleteServersTestJSON-2110766679-project Sep 01 17:38:09.150115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:38:09.150115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:09.150115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': 'ab8419fc-b28b-4b08-9d93-85239477e211'} Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:38:09.150973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:09.152159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:09.154615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-57f4ac2b-2be9-46ba-9b3a-1f5dff7ce45c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Returning 404 to user: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:38:09.154615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-57f4ac2b-2be9-46ba-9b3a-1f5dff7ce45c tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 404 len: 111 microversion: 2.1 time: 0.064934 Sep 01 17:38:09.154615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 112/208] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:09 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 17:38:09.161427 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ef13577a-71e7-4bb5-a937-88e6c4c5c058 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.162252 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ef13577a-71e7-4bb5-a937-88e6c4c5c058 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.162699 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ef13577a-71e7-4bb5-a937-88e6c4c5c058 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.163419 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ef13577a-71e7-4bb5-a937-88e6c4c5c058 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.163941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ef13577a-71e7-4bb5-a937-88e6c4c5c058 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.164373 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ef13577a-71e7-4bb5-a937-88e6c4c5c058 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.168282 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c217d98c-b925-4322-a575-9a0e6598b9ca tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:09.170860 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c217d98c-b925-4322-a575-9a0e6598b9ca tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:09.332751 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c217d98c-b925-4322-a575-9a0e6598b9ca tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:09.340511 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-c217d98c-b925-4322-a575-9a0e6598b9ca tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1218 microversion: 2.1 time: 0.182055 Sep 01 17:38:09.341689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 113/209] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:09 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1218 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:09.359100 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6a2a7a30-8d25-489f-85f1-a8ca19281ae6 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:09.363336 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6a2a7a30-8d25-489f-85f1-a8ca19281ae6 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:09.371657 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6a2a7a30-8d25-489f-85f1-a8ca19281ae6 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.372146 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6a2a7a30-8d25-489f-85f1-a8ca19281ae6 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.372573 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6a2a7a30-8d25-489f-85f1-a8ca19281ae6 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.373266 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6a2a7a30-8d25-489f-85f1-a8ca19281ae6 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.373744 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6a2a7a30-8d25-489f-85f1-a8ca19281ae6 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.374465 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6a2a7a30-8d25-489f-85f1-a8ca19281ae6 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.389421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-6a2a7a30-8d25-489f-85f1-a8ca19281ae6 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] HTTP exception thrown: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6a2a7a30-8d25-489f-85f1-a8ca19281ae6 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Request method failure captured: Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211/os-volume_attachments HTTP/1.1 Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2rV_OGsNArr36VJ1rcbsKezghLrMBZLU2-U9_mLsTbTSqUyJ3NilAabNHGS_UHrn-BHWI_ZDU-etqiDFEF_LDkLlqkcqXFczZ_D3rJOG5DTPWCWYXzp0Cg8yoMkdjtCxZBbKQ8plseNKsXjGlJx_CocfMU_nsjA_NHUroQhbIiAOA Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: df3925a7fb6c4d099c4f160d42870a3b Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-DeleteServersTestJSON-2110766679 Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:38:09.391493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:38:09.392700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:38:09.392700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-DeleteServersTestJSON-2110766679 Sep 01 17:38:09.392700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: df3925a7fb6c4d099c4f160d42870a3b Sep 01 17:38:09.392700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-DeleteServersTestJSON-2110766679 Sep 01 17:38:09.392700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-DeleteServersTestJSON-2110766679-project Sep 01 17:38:09.392700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:38:09.392700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:38:09.392700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: bcea72e4fc77431a96e7acf9d68eb083 Sep 01 17:38:09.392700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-DeleteServersTestJSON-2110766679-project Sep 01 17:38:09.392700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:38:09.392700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:09.392700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'server_id': 'ab8419fc-b28b-4b08-9d93-85239477e211'} Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:38:09.393805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:09.394929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:09.397473 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6a2a7a30-8d25-489f-85f1-a8ca19281ae6 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Returning 404 to user: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:38:09.398670 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-6a2a7a30-8d25-489f-85f1-a8ca19281ae6 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043515 Sep 01 17:38:09.399806 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 114/210] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:38:09 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:38:09.428954 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ef13577a-71e7-4bb5-a937-88e6c4c5c058 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:09.439727 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ef13577a-71e7-4bb5-a937-88e6c4c5c058 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.298147 Sep 01 17:38:09.440616 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 97/211] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:09 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:09.603202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8cce2022-166b-4222-bb16-8e358343f1c8 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:09.604107 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8cce2022-166b-4222-bb16-8e358343f1c8 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:09.618146 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8cce2022-166b-4222-bb16-8e358343f1c8 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.619268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8cce2022-166b-4222-bb16-8e358343f1c8 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.620856 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8cce2022-166b-4222-bb16-8e358343f1c8 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.621756 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8cce2022-166b-4222-bb16-8e358343f1c8 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.622579 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8cce2022-166b-4222-bb16-8e358343f1c8 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.623115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8cce2022-166b-4222-bb16-8e358343f1c8 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.800095 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8cce2022-166b-4222-bb16-8e358343f1c8 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:09.810752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8cce2022-166b-4222-bb16-8e358343f1c8 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1318 microversion: 2.1 time: 0.211951 Sep 01 17:38:09.811795 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 115/212] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:09 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:09.844728 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-394343e7-74e4-49ca-ab96-7369d086c6b6 req-6b7ffb9e-a893-4bf3-a1ad-39eeaecbe2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95fb669-aa1f-43d4-af34-44437825c6e6", "name": "network-vif-plugged", "status": "completed", "tag": "02ec5ddb-bbdf-4e77-9dba-4c030c16cba2"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:09.857050 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-394343e7-74e4-49ca-ab96-7369d086c6b6 req-6b7ffb9e-a893-4bf3-a1ad-39eeaecbe2ec service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.857910 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-394343e7-74e4-49ca-ab96-7369d086c6b6 req-6b7ffb9e-a893-4bf3-a1ad-39eeaecbe2ec service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.858508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-394343e7-74e4-49ca-ab96-7369d086c6b6 req-6b7ffb9e-a893-4bf3-a1ad-39eeaecbe2ec service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.872636 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-394343e7-74e4-49ca-ab96-7369d086c6b6 req-6b7ffb9e-a893-4bf3-a1ad-39eeaecbe2ec service nova] Creating event network-vif-plugged:02ec5ddb-bbdf-4e77-9dba-4c030c16cba2 for instance f95fb669-aa1f-43d4-af34-44437825c6e6 on hv-cinder-83976 Sep 01 17:38:09.880081 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-394343e7-74e4-49ca-ab96-7369d086c6b6 req-6b7ffb9e-a893-4bf3-a1ad-39eeaecbe2ec service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039485 Sep 01 17:38:09.880927 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 98/213] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:10.361598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-02c529c8-7a95-4831-a20c-e586f468e992 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:10.363826 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-02c529c8-7a95-4831-a20c-e586f468e992 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:10.372268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-02c529c8-7a95-4831-a20c-e586f468e992 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.372773 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-02c529c8-7a95-4831-a20c-e586f468e992 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.373221 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-02c529c8-7a95-4831-a20c-e586f468e992 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:10.373960 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-02c529c8-7a95-4831-a20c-e586f468e992 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.374422 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-02c529c8-7a95-4831-a20c-e586f468e992 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.374848 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-02c529c8-7a95-4831-a20c-e586f468e992 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:10.464791 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-01ab34aa-f7f3-488e-861c-9b9d8e93f4e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:10.467011 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-01ab34aa-f7f3-488e-861c-9b9d8e93f4e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:10.474333 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-01ab34aa-f7f3-488e-861c-9b9d8e93f4e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.475268 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-01ab34aa-f7f3-488e-861c-9b9d8e93f4e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.476158 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-01ab34aa-f7f3-488e-861c-9b9d8e93f4e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:10.477150 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-01ab34aa-f7f3-488e-861c-9b9d8e93f4e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.478590 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-01ab34aa-f7f3-488e-861c-9b9d8e93f4e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.479259 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-01ab34aa-f7f3-488e-861c-9b9d8e93f4e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:10.509450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-02c529c8-7a95-4831-a20c-e586f468e992 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:10.520980 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-02c529c8-7a95-4831-a20c-e586f468e992 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1270 microversion: 2.1 time: 0.163065 Sep 01 17:38:10.547040 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 116/214] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:10 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1270 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:10.677958 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-924d3f4c-650f-46d9-9d0e-03522bb767ea tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:10.678569 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-924d3f4c-650f-46d9-9d0e-03522bb767ea tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:10.685541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-924d3f4c-650f-46d9-9d0e-03522bb767ea tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.686263 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-924d3f4c-650f-46d9-9d0e-03522bb767ea tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.687023 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-924d3f4c-650f-46d9-9d0e-03522bb767ea tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:10.688240 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-924d3f4c-650f-46d9-9d0e-03522bb767ea tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.688850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-924d3f4c-650f-46d9-9d0e-03522bb767ea tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.689426 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-924d3f4c-650f-46d9-9d0e-03522bb767ea tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:10.702134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-01ab34aa-f7f3-488e-861c-9b9d8e93f4e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:10.715213 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-01ab34aa-f7f3-488e-861c-9b9d8e93f4e7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.255242 Sep 01 17:38:10.715798 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 99/215] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:10 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:10.727925 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-924d3f4c-650f-46d9-9d0e-03522bb767ea tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] HTTP exception thrown: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-924d3f4c-650f-46d9-9d0e-03522bb767ea tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Request method failure captured: Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: DELETE /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 HTTP/1.1 Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2rV_OGsNArr36VJ1rcbsKezghLrMBZLU2-U9_mLsTbTSqUyJ3NilAabNHGS_UHrn-BHWI_ZDU-etqiDFEF_LDkLlqkcqXFczZ_D3rJOG5DTPWCWYXzp0Cg8yoMkdjtCxZBbKQ8plseNKsXjGlJx_CocfMU_nsjA_NHUroQhbIiAOA Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: df3925a7fb6c4d099c4f160d42870a3b Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-DeleteServersTestJSON-2110766679 Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:38:10.729810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:38:10.731933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:38:10.731933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-DeleteServersTestJSON-2110766679 Sep 01 17:38:10.731933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: df3925a7fb6c4d099c4f160d42870a3b Sep 01 17:38:10.731933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-DeleteServersTestJSON-2110766679 Sep 01 17:38:10.731933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-DeleteServersTestJSON-2110766679-project Sep 01 17:38:10.731933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:38:10.731933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:38:10.731933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: bcea72e4fc77431a96e7acf9d68eb083 Sep 01 17:38:10.731933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-DeleteServersTestJSON-2110766679-project Sep 01 17:38:10.731933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:38:10.731933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:10.731933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': 'ab8419fc-b28b-4b08-9d93-85239477e211'} Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:38:10.732667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:10.733876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:10.734963 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-924d3f4c-650f-46d9-9d0e-03522bb767ea tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Returning 404 to user: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:38:10.734963 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-924d3f4c-650f-46d9-9d0e-03522bb767ea tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 404 len: 111 microversion: 2.1 time: 0.059139 Sep 01 17:38:10.734963 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 117/216] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:38:10 2022] DELETE /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:38:10.740855 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-121f111d-11fa-4f2f-8d67-7a1c441490d8 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:10.741471 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-121f111d-11fa-4f2f-8d67-7a1c441490d8 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] [instance: ab8419fc-b28b-4b08-9d93-85239477e211] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:10.748375 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-121f111d-11fa-4f2f-8d67-7a1c441490d8 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.748863 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-121f111d-11fa-4f2f-8d67-7a1c441490d8 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.749307 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-121f111d-11fa-4f2f-8d67-7a1c441490d8 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:10.750031 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-121f111d-11fa-4f2f-8d67-7a1c441490d8 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.750490 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-121f111d-11fa-4f2f-8d67-7a1c441490d8 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.750915 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-121f111d-11fa-4f2f-8d67-7a1c441490d8 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:10.764680 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-121f111d-11fa-4f2f-8d67-7a1c441490d8 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] HTTP exception thrown: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-121f111d-11fa-4f2f-8d67-7a1c441490d8 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Request method failure captured: Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 HTTP/1.1 Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO2rV_OGsNArr36VJ1rcbsKezghLrMBZLU2-U9_mLsTbTSqUyJ3NilAabNHGS_UHrn-BHWI_ZDU-etqiDFEF_LDkLlqkcqXFczZ_D3rJOG5DTPWCWYXzp0Cg8yoMkdjtCxZBbKQ8plseNKsXjGlJx_CocfMU_nsjA_NHUroQhbIiAOA Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: df3925a7fb6c4d099c4f160d42870a3b Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-DeleteServersTestJSON-2110766679 Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:38:10.770185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:38:10.771578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/df3925a7fb6c4d099c4f160d42870a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:38:10.771578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-DeleteServersTestJSON-2110766679 Sep 01 17:38:10.771578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: df3925a7fb6c4d099c4f160d42870a3b Sep 01 17:38:10.771578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-DeleteServersTestJSON-2110766679 Sep 01 17:38:10.771578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-DeleteServersTestJSON-2110766679-project Sep 01 17:38:10.771578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:38:10.771578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:38:10.771578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: bcea72e4fc77431a96e7acf9d68eb083 Sep 01 17:38:10.771578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-DeleteServersTestJSON-2110766679-project Sep 01 17:38:10.771578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:38:10.771578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:10.771578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': 'ab8419fc-b28b-4b08-9d93-85239477e211'} Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:38:10.772415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. Sep 01 17:38:10.773688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:38:10.774994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-121f111d-11fa-4f2f-8d67-7a1c441490d8 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] Returning 404 to user: Instance ab8419fc-b28b-4b08-9d93-85239477e211 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:38:10.774994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-121f111d-11fa-4f2f-8d67-7a1c441490d8 tempest-DeleteServersTestJSON-2110766679 tempest-DeleteServersTestJSON-2110766679-project] 10.222.0.100 "GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211" status: 404 len: 111 microversion: 2.1 time: 0.035299 Sep 01 17:38:10.774994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 100/217] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:10 2022] GET /compute/v2.1/servers/ab8419fc-b28b-4b08-9d93-85239477e211 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:38:10.832188 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1315f233-45ff-4d1f-8f13-8d7809063499 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:10.832949 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-1315f233-45ff-4d1f-8f13-8d7809063499 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:10.842566 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1315f233-45ff-4d1f-8f13-8d7809063499 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.843056 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1315f233-45ff-4d1f-8f13-8d7809063499 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.843489 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1315f233-45ff-4d1f-8f13-8d7809063499 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:10.844505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1315f233-45ff-4d1f-8f13-8d7809063499 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.844992 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1315f233-45ff-4d1f-8f13-8d7809063499 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.845420 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1315f233-45ff-4d1f-8f13-8d7809063499 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:11.017499 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-1315f233-45ff-4d1f-8f13-8d7809063499 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:11.029091 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1315f233-45ff-4d1f-8f13-8d7809063499 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1318 microversion: 2.1 time: 0.200016 Sep 01 17:38:11.029707 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 118/218] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:10 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:11.559653 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a1fb41f6-bdfe-4b7d-80b9-6707b1be3d16 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:11.561453 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a1fb41f6-bdfe-4b7d-80b9-6707b1be3d16 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:11.568051 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a1fb41f6-bdfe-4b7d-80b9-6707b1be3d16 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:11.569066 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a1fb41f6-bdfe-4b7d-80b9-6707b1be3d16 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:11.569604 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a1fb41f6-bdfe-4b7d-80b9-6707b1be3d16 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:11.570418 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a1fb41f6-bdfe-4b7d-80b9-6707b1be3d16 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:11.571069 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a1fb41f6-bdfe-4b7d-80b9-6707b1be3d16 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:11.572007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a1fb41f6-bdfe-4b7d-80b9-6707b1be3d16 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:11.642545 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a1fb41f6-bdfe-4b7d-80b9-6707b1be3d16 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:11.651125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a1fb41f6-bdfe-4b7d-80b9-6707b1be3d16 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1270 microversion: 2.1 time: 0.095902 Sep 01 17:38:11.651125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 101/219] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:11 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:11.739113 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-321499c1-e9c0-4a38-af7b-e0816dbaaa10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:11.739951 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-321499c1-e9c0-4a38-af7b-e0816dbaaa10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:11.746952 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-321499c1-e9c0-4a38-af7b-e0816dbaaa10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:11.747446 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-321499c1-e9c0-4a38-af7b-e0816dbaaa10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:11.747878 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-321499c1-e9c0-4a38-af7b-e0816dbaaa10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:11.748595 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-321499c1-e9c0-4a38-af7b-e0816dbaaa10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:11.749041 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-321499c1-e9c0-4a38-af7b-e0816dbaaa10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:11.749454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-321499c1-e9c0-4a38-af7b-e0816dbaaa10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:11.945112 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-321499c1-e9c0-4a38-af7b-e0816dbaaa10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:11.955148 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-321499c1-e9c0-4a38-af7b-e0816dbaaa10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1526 microversion: 2.1 time: 0.220307 Sep 01 17:38:11.955787 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 119/220] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:11 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1526 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:12.050938 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-0a3ece55-d0b2-4734-94b8-4a20ec3b02a0 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:12.051528 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-0a3ece55-d0b2-4734-94b8-4a20ec3b02a0 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:12.057930 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0a3ece55-d0b2-4734-94b8-4a20ec3b02a0 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:12.058409 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0a3ece55-d0b2-4734-94b8-4a20ec3b02a0 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:12.058850 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0a3ece55-d0b2-4734-94b8-4a20ec3b02a0 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:12.059522 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0a3ece55-d0b2-4734-94b8-4a20ec3b02a0 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:12.059968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0a3ece55-d0b2-4734-94b8-4a20ec3b02a0 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:12.060388 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0a3ece55-d0b2-4734-94b8-4a20ec3b02a0 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:12.197909 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-0a3ece55-d0b2-4734-94b8-4a20ec3b02a0 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:12.226595 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-0a3ece55-d0b2-4734-94b8-4a20ec3b02a0 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1318 microversion: 2.1 time: 0.179064 Sep 01 17:38:12.228177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 102/221] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:12 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:12.672147 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-137929e1-f3bd-4138-b106-e53eae9e82f0 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:12.674113 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-137929e1-f3bd-4138-b106-e53eae9e82f0 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:12.687137 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-137929e1-f3bd-4138-b106-e53eae9e82f0 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:12.687776 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-137929e1-f3bd-4138-b106-e53eae9e82f0 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:12.688775 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-137929e1-f3bd-4138-b106-e53eae9e82f0 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:12.690125 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-137929e1-f3bd-4138-b106-e53eae9e82f0 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:12.690853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-137929e1-f3bd-4138-b106-e53eae9e82f0 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:12.691490 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-137929e1-f3bd-4138-b106-e53eae9e82f0 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:12.784004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-137929e1-f3bd-4138-b106-e53eae9e82f0 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:12.799121 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-137929e1-f3bd-4138-b106-e53eae9e82f0 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1270 microversion: 2.1 time: 0.130883 Sep 01 17:38:12.801906 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 120/222] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:12 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:12.979519 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ca7ecff9-38b8-479e-9ced-cb7705f0f3dc tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:12.981151 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ca7ecff9-38b8-479e-9ced-cb7705f0f3dc tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:13.005221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ca7ecff9-38b8-479e-9ced-cb7705f0f3dc tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:13.005944 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ca7ecff9-38b8-479e-9ced-cb7705f0f3dc tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:13.007418 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ca7ecff9-38b8-479e-9ced-cb7705f0f3dc tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:13.008307 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ca7ecff9-38b8-479e-9ced-cb7705f0f3dc tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:13.009875 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ca7ecff9-38b8-479e-9ced-cb7705f0f3dc tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:13.010855 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ca7ecff9-38b8-479e-9ced-cb7705f0f3dc tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:13.239884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ca7ecff9-38b8-479e-9ced-cb7705f0f3dc tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:13.250801 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ca7ecff9-38b8-479e-9ced-cb7705f0f3dc tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1506 microversion: 2.1 time: 0.277324 Sep 01 17:38:13.251213 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4321ac34-ee07-49a2-ac33-8286c3507eef tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:13.251984 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4321ac34-ee07-49a2-ac33-8286c3507eef tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:13.254096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 103/223] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:12 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:13.260909 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4321ac34-ee07-49a2-ac33-8286c3507eef tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:13.264372 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4321ac34-ee07-49a2-ac33-8286c3507eef tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:13.266400 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4321ac34-ee07-49a2-ac33-8286c3507eef tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:13.268336 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4321ac34-ee07-49a2-ac33-8286c3507eef tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:13.274405 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-1f25aa52-4de4-42ae-b047-9a865ddcbc5b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:13.275573 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-1f25aa52-4de4-42ae-b047-9a865ddcbc5b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:13.281795 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4321ac34-ee07-49a2-ac33-8286c3507eef tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:13.282838 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1f25aa52-4de4-42ae-b047-9a865ddcbc5b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:13.283544 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1f25aa52-4de4-42ae-b047-9a865ddcbc5b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:13.284379 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1f25aa52-4de4-42ae-b047-9a865ddcbc5b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:13.285732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4321ac34-ee07-49a2-ac33-8286c3507eef tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:13.286221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1f25aa52-4de4-42ae-b047-9a865ddcbc5b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:13.287168 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1f25aa52-4de4-42ae-b047-9a865ddcbc5b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:13.287815 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1f25aa52-4de4-42ae-b047-9a865ddcbc5b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:13.629397 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4321ac34-ee07-49a2-ac33-8286c3507eef tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:13.642739 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4321ac34-ee07-49a2-ac33-8286c3507eef tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1502 microversion: 2.1 time: 0.396732 Sep 01 17:38:13.644180 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 121/224] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:13 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1502 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:13.664388 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1f25aa52-4de4-42ae-b047-9a865ddcbc5b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:13.674263 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-1f25aa52-4de4-42ae-b047-9a865ddcbc5b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1519 microversion: 2.1 time: 0.404078 Sep 01 17:38:13.681942 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 104/225] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:13 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1519 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:13.820461 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a07284e2-f638-4e46-80c8-77d626f750cf tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:13.821670 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a07284e2-f638-4e46-80c8-77d626f750cf tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:13.828202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a07284e2-f638-4e46-80c8-77d626f750cf tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:13.828931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a07284e2-f638-4e46-80c8-77d626f750cf tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:13.829524 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a07284e2-f638-4e46-80c8-77d626f750cf tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:13.830706 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a07284e2-f638-4e46-80c8-77d626f750cf tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:13.831172 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a07284e2-f638-4e46-80c8-77d626f750cf tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:13.831594 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a07284e2-f638-4e46-80c8-77d626f750cf tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:13.926928 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a07284e2-f638-4e46-80c8-77d626f750cf tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:13.937448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a07284e2-f638-4e46-80c8-77d626f750cf tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1276 microversion: 2.1 time: 0.121017 Sep 01 17:38:13.940839 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 122/226] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:13 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1276 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:14.965178 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2a39d52b-b211-4689-8ce8-fa58cb9981e4 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:14.965976 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2a39d52b-b211-4689-8ce8-fa58cb9981e4 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:14.972530 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a39d52b-b211-4689-8ce8-fa58cb9981e4 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:14.973031 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a39d52b-b211-4689-8ce8-fa58cb9981e4 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:14.978099 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a39d52b-b211-4689-8ce8-fa58cb9981e4 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:14.980452 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a39d52b-b211-4689-8ce8-fa58cb9981e4 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:14.984561 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a39d52b-b211-4689-8ce8-fa58cb9981e4 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:14.985487 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a39d52b-b211-4689-8ce8-fa58cb9981e4 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:15.122380 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2a39d52b-b211-4689-8ce8-fa58cb9981e4 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:15.134649 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2a39d52b-b211-4689-8ce8-fa58cb9981e4 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1276 microversion: 2.1 time: 0.171958 Sep 01 17:38:15.135689 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 105/227] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:14 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:16.156467 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cd8aaf84-514c-4ed7-81a2-10557a94bede tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:16.157086 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cd8aaf84-514c-4ed7-81a2-10557a94bede tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:16.165201 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cd8aaf84-514c-4ed7-81a2-10557a94bede tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:16.168409 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cd8aaf84-514c-4ed7-81a2-10557a94bede tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:16.169730 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cd8aaf84-514c-4ed7-81a2-10557a94bede tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:16.170858 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cd8aaf84-514c-4ed7-81a2-10557a94bede tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:16.172717 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cd8aaf84-514c-4ed7-81a2-10557a94bede tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:16.173834 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cd8aaf84-514c-4ed7-81a2-10557a94bede tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:16.256822 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cd8aaf84-514c-4ed7-81a2-10557a94bede tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:16.266753 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cd8aaf84-514c-4ed7-81a2-10557a94bede tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1276 microversion: 2.1 time: 0.113953 Sep 01 17:38:16.268323 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 123/228] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:16 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:16.776453 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-1d6b9b3f-216b-4b1e-8fe9-7c314b016bb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:16.779435 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-1d6b9b3f-216b-4b1e-8fe9-7c314b016bb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:16.792806 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1d6b9b3f-216b-4b1e-8fe9-7c314b016bb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:16.795246 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1d6b9b3f-216b-4b1e-8fe9-7c314b016bb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:16.803931 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1d6b9b3f-216b-4b1e-8fe9-7c314b016bb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:16.805327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1d6b9b3f-216b-4b1e-8fe9-7c314b016bb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:16.809222 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1d6b9b3f-216b-4b1e-8fe9-7c314b016bb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:16.810371 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1d6b9b3f-216b-4b1e-8fe9-7c314b016bb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:16.822342 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=100 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:16.911363 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-1d6b9b3f-216b-4b1e-8fe9-7c314b016bb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lazy-loading 'flavor' on Instance uuid 0f637e8e-d6ed-4516-b57d-48174aa65926 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:17.088607 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-1d6b9b3f-216b-4b1e-8fe9-7c314b016bb8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "POST /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926/action" status: 200 len: 32 microversion: 2.1 time: 0.316186 Sep 01 17:38:17.103929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-421e9c37-9925-4b0d-a684-57f80aa276fd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:17.106486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-421e9c37-9925-4b0d-a684-57f80aa276fd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:17.106908 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 106/229] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:38:16 2022] POST /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926/action => generated 32 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:38:17.126892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-421e9c37-9925-4b0d-a684-57f80aa276fd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:17.127388 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-421e9c37-9925-4b0d-a684-57f80aa276fd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:17.127819 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-421e9c37-9925-4b0d-a684-57f80aa276fd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:17.128524 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-421e9c37-9925-4b0d-a684-57f80aa276fd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:17.137920 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-421e9c37-9925-4b0d-a684-57f80aa276fd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:17.138364 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-421e9c37-9925-4b0d-a684-57f80aa276fd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:17.289039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d519c855-28ff-4e40-8cdc-7a3dbf3c0468 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:17.291511 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d519c855-28ff-4e40-8cdc-7a3dbf3c0468 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:17.307232 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d519c855-28ff-4e40-8cdc-7a3dbf3c0468 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:17.307993 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d519c855-28ff-4e40-8cdc-7a3dbf3c0468 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:17.308781 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d519c855-28ff-4e40-8cdc-7a3dbf3c0468 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:17.311135 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d519c855-28ff-4e40-8cdc-7a3dbf3c0468 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:17.312196 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d519c855-28ff-4e40-8cdc-7a3dbf3c0468 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:17.315107 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d519c855-28ff-4e40-8cdc-7a3dbf3c0468 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:17.408026 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-421e9c37-9925-4b0d-a684-57f80aa276fd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:17.425779 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-421e9c37-9925-4b0d-a684-57f80aa276fd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.329269 Sep 01 17:38:17.433908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 124/230] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:17 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:17.445055 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c5637801-0189-40af-afa1-6592c2d9c34c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:17.448552 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c5637801-0189-40af-afa1-6592c2d9c34c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:17.467685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c5637801-0189-40af-afa1-6592c2d9c34c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:17.468571 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c5637801-0189-40af-afa1-6592c2d9c34c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:17.469420 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c5637801-0189-40af-afa1-6592c2d9c34c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:17.473617 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c5637801-0189-40af-afa1-6592c2d9c34c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:17.475563 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c5637801-0189-40af-afa1-6592c2d9c34c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:17.476001 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c5637801-0189-40af-afa1-6592c2d9c34c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:17.563941 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c5637801-0189-40af-afa1-6592c2d9c34c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Going to try to terminate instance {{(pid=127233) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:38:17.728475 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d519c855-28ff-4e40-8cdc-7a3dbf3c0468 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:17.746657 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d519c855-28ff-4e40-8cdc-7a3dbf3c0468 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1318 microversion: 2.1 time: 0.458942 Sep 01 17:38:17.760887 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 107/231] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:17 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:17.798192 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-c5637801-0189-40af-afa1-6592c2d9c34c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "DELETE /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 204 len: 0 microversion: 2.1 time: 0.360983 Sep 01 17:38:17.798802 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 125/232] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:38:17 2022] DELETE /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:38:17.808110 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ec08e186-b4d1-484d-a850-600675c84949 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:17.808801 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ec08e186-b4d1-484d-a850-600675c84949 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:17.816685 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ec08e186-b4d1-484d-a850-600675c84949 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:17.817602 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ec08e186-b4d1-484d-a850-600675c84949 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:17.818225 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ec08e186-b4d1-484d-a850-600675c84949 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:17.819299 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ec08e186-b4d1-484d-a850-600675c84949 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:17.819911 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ec08e186-b4d1-484d-a850-600675c84949 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:17.820493 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ec08e186-b4d1-484d-a850-600675c84949 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:18.040938 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ec08e186-b4d1-484d-a850-600675c84949 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:18.056531 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ec08e186-b4d1-484d-a850-600675c84949 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1508 microversion: 2.1 time: 0.252476 Sep 01 17:38:18.058290 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 108/233] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:17 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:18.456941 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a131a97a-803b-4f62-83a5-8bc27e09c9a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:18.458678 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a131a97a-803b-4f62-83a5-8bc27e09c9a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:18.469434 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a131a97a-803b-4f62-83a5-8bc27e09c9a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:18.470158 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a131a97a-803b-4f62-83a5-8bc27e09c9a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:18.470828 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a131a97a-803b-4f62-83a5-8bc27e09c9a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:18.471572 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a131a97a-803b-4f62-83a5-8bc27e09c9a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:18.472186 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a131a97a-803b-4f62-83a5-8bc27e09c9a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:18.472816 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a131a97a-803b-4f62-83a5-8bc27e09c9a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:18.721795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-42367acf-946f-45e5-8b33-db6b509052ec req-faab1b75-3ec9-4266-af8d-8915a70756d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cacff4e-2af1-4eb3-af71-37d8570012a4", "tag": "4aabc61d-1a2d-4799-9322-795491f3c788"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:18.734240 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-42367acf-946f-45e5-8b33-db6b509052ec req-faab1b75-3ec9-4266-af8d-8915a70756d5 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:18.735046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-42367acf-946f-45e5-8b33-db6b509052ec req-faab1b75-3ec9-4266-af8d-8915a70756d5 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:18.735680 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-42367acf-946f-45e5-8b33-db6b509052ec req-faab1b75-3ec9-4266-af8d-8915a70756d5 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:18.740836 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a131a97a-803b-4f62-83a5-8bc27e09c9a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:18.761948 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-42367acf-946f-45e5-8b33-db6b509052ec req-faab1b75-3ec9-4266-af8d-8915a70756d5 service nova] Creating event network-changed:4aabc61d-1a2d-4799-9322-795491f3c788 for instance 5cacff4e-2af1-4eb3-af71-37d8570012a4 on hv-cinder-83976 Sep 01 17:38:18.770524 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a131a97a-803b-4f62-83a5-8bc27e09c9a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.319180 Sep 01 17:38:18.772136 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 126/234] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:18 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:18.779476 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-42367acf-946f-45e5-8b33-db6b509052ec req-faab1b75-3ec9-4266-af8d-8915a70756d5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062870 Sep 01 17:38:18.780714 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 109/235] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:38:18.785151 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e98e7c47-ef68-4566-af3a-6f60ce00a6ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:18.785812 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e98e7c47-ef68-4566-af3a-6f60ce00a6ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:18.805703 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e98e7c47-ef68-4566-af3a-6f60ce00a6ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:18.806644 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e98e7c47-ef68-4566-af3a-6f60ce00a6ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:18.807231 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e98e7c47-ef68-4566-af3a-6f60ce00a6ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:18.808241 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e98e7c47-ef68-4566-af3a-6f60ce00a6ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:18.808836 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e98e7c47-ef68-4566-af3a-6f60ce00a6ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:18.809411 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e98e7c47-ef68-4566-af3a-6f60ce00a6ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:19.039132 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e98e7c47-ef68-4566-af3a-6f60ce00a6ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:19.045399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:19.063970 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e98e7c47-ef68-4566-af3a-6f60ce00a6ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1318 microversion: 2.1 time: 0.290072 Sep 01 17:38:19.069668 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 127/236] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:18 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:19.089035 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-1bd957b3-0b6a-4774-b067-8b5d07e63525 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:19.089794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-1bd957b3-0b6a-4774-b067-8b5d07e63525 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:19.119421 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:19.120743 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=6 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:19.158530 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1bd957b3-0b6a-4774-b067-8b5d07e63525 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:19.162455 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1bd957b3-0b6a-4774-b067-8b5d07e63525 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:19.163117 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1bd957b3-0b6a-4774-b067-8b5d07e63525 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:19.164045 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1bd957b3-0b6a-4774-b067-8b5d07e63525 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:19.165153 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1bd957b3-0b6a-4774-b067-8b5d07e63525 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:19.165836 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1bd957b3-0b6a-4774-b067-8b5d07e63525 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:19.701366 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1bd957b3-0b6a-4774-b067-8b5d07e63525 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:19.709943 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-1bd957b3-0b6a-4774-b067-8b5d07e63525 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1508 microversion: 2.1 time: 0.630265 Sep 01 17:38:19.710624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 110/237] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:19 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1508 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:19.794026 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:19.800225 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-936e7201-7516-40d7-8cc2-e76ca3d313ce tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:19.801053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-936e7201-7516-40d7-8cc2-e76ca3d313ce tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:19.810278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-936e7201-7516-40d7-8cc2-e76ca3d313ce tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:19.811039 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-936e7201-7516-40d7-8cc2-e76ca3d313ce tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:19.811536 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-936e7201-7516-40d7-8cc2-e76ca3d313ce tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:19.812302 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-936e7201-7516-40d7-8cc2-e76ca3d313ce tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:19.812820 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-936e7201-7516-40d7-8cc2-e76ca3d313ce tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:19.813303 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-936e7201-7516-40d7-8cc2-e76ca3d313ce tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:20.084227 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8d007dd5-6dd3-4d58-b81c-21d52123ab63 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:20.084838 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8d007dd5-6dd3-4d58-b81c-21d52123ab63 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:20.101115 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8d007dd5-6dd3-4d58-b81c-21d52123ab63 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:20.101773 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8d007dd5-6dd3-4d58-b81c-21d52123ab63 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:20.102073 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8d007dd5-6dd3-4d58-b81c-21d52123ab63 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:20.102784 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8d007dd5-6dd3-4d58-b81c-21d52123ab63 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:20.103238 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8d007dd5-6dd3-4d58-b81c-21d52123ab63 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:20.103661 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8d007dd5-6dd3-4d58-b81c-21d52123ab63 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:20.617959 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-936e7201-7516-40d7-8cc2-e76ca3d313ce tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:20.636535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-936e7201-7516-40d7-8cc2-e76ca3d313ce tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.846714 Sep 01 17:38:20.650988 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 128/238] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:19 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:20.661849 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8d007dd5-6dd3-4d58-b81c-21d52123ab63 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:20.681207 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8d007dd5-6dd3-4d58-b81c-21d52123ab63 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1318 microversion: 2.1 time: 0.599819 Sep 01 17:38:20.684329 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 111/239] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:20 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:20.735772 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-579e9b39-4f53-472b-87a7-e43547b1d3d6 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:20.736398 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-579e9b39-4f53-472b-87a7-e43547b1d3d6 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:20.764759 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-579e9b39-4f53-472b-87a7-e43547b1d3d6 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:20.768478 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-579e9b39-4f53-472b-87a7-e43547b1d3d6 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:20.776321 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-579e9b39-4f53-472b-87a7-e43547b1d3d6 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:20.779457 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-579e9b39-4f53-472b-87a7-e43547b1d3d6 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:20.781407 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-579e9b39-4f53-472b-87a7-e43547b1d3d6 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:20.783073 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-579e9b39-4f53-472b-87a7-e43547b1d3d6 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:21.275079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-579e9b39-4f53-472b-87a7-e43547b1d3d6 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:21.287803 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-579e9b39-4f53-472b-87a7-e43547b1d3d6 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 200 len: 1508 microversion: 2.1 time: 0.556486 Sep 01 17:38:21.297943 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 129/240] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:20 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 1508 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:21.364774 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-6a61047f-a39c-4b70-b568-7370773c55fe req-c86f5ce9-4d65-4e81-b95c-114599a2d331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95fb669-aa1f-43d4-af34-44437825c6e6", "name": "network-vif-deleted", "tag": "02ec5ddb-bbdf-4e77-9dba-4c030c16cba2"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:21.374361 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-6a61047f-a39c-4b70-b568-7370773c55fe req-c86f5ce9-4d65-4e81-b95c-114599a2d331 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:21.374871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-6a61047f-a39c-4b70-b568-7370773c55fe req-c86f5ce9-4d65-4e81-b95c-114599a2d331 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:21.375591 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-6a61047f-a39c-4b70-b568-7370773c55fe req-c86f5ce9-4d65-4e81-b95c-114599a2d331 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:21.389613 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-6a61047f-a39c-4b70-b568-7370773c55fe req-c86f5ce9-4d65-4e81-b95c-114599a2d331 service nova] Creating event network-vif-deleted:02ec5ddb-bbdf-4e77-9dba-4c030c16cba2 for instance f95fb669-aa1f-43d4-af34-44437825c6e6 on hv-cinder-83976 Sep 01 17:38:21.394918 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-6a61047f-a39c-4b70-b568-7370773c55fe req-c86f5ce9-4d65-4e81-b95c-114599a2d331 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033692 Sep 01 17:38:21.396234 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 112/241] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:21.671236 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2036486a-bacd-409e-a8da-c0d9ceb5828c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:21.680198 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2036486a-bacd-409e-a8da-c0d9ceb5828c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:21.686905 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2036486a-bacd-409e-a8da-c0d9ceb5828c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:21.688323 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2036486a-bacd-409e-a8da-c0d9ceb5828c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:21.688897 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2036486a-bacd-409e-a8da-c0d9ceb5828c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:21.690592 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2036486a-bacd-409e-a8da-c0d9ceb5828c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:21.696742 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2036486a-bacd-409e-a8da-c0d9ceb5828c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:21.697508 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2036486a-bacd-409e-a8da-c0d9ceb5828c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:21.704886 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cebd8a04-4487-4f12-a1a0-61b75fc3b118 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:21.705960 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-cebd8a04-4487-4f12-a1a0-61b75fc3b118 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:21.716304 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cebd8a04-4487-4f12-a1a0-61b75fc3b118 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:21.717463 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cebd8a04-4487-4f12-a1a0-61b75fc3b118 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:21.718168 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cebd8a04-4487-4f12-a1a0-61b75fc3b118 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:21.719096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cebd8a04-4487-4f12-a1a0-61b75fc3b118 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:21.719740 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cebd8a04-4487-4f12-a1a0-61b75fc3b118 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:21.720352 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cebd8a04-4487-4f12-a1a0-61b75fc3b118 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:22.131254 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2036486a-bacd-409e-a8da-c0d9ceb5828c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:22.151493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2036486a-bacd-409e-a8da-c0d9ceb5828c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.483981 Sep 01 17:38:22.165533 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 130/242] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:21 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:22.311864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-989180a6-2a1a-4365-99c1-abf18e253ead tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:22.312542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-989180a6-2a1a-4365-99c1-abf18e253ead tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: f95fb669-aa1f-43d4-af34-44437825c6e6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:22.319217 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-989180a6-2a1a-4365-99c1-abf18e253ead tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:22.319707 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-989180a6-2a1a-4365-99c1-abf18e253ead tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:22.320138 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-989180a6-2a1a-4365-99c1-abf18e253ead tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:22.327296 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-989180a6-2a1a-4365-99c1-abf18e253ead tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:22.328822 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-989180a6-2a1a-4365-99c1-abf18e253ead tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:22.331176 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-989180a6-2a1a-4365-99c1-abf18e253ead tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:22.352364 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-989180a6-2a1a-4365-99c1-abf18e253ead tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] HTTP exception thrown: Instance f95fb669-aa1f-43d4-af34-44437825c6e6 could not be found. Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-989180a6-2a1a-4365-99c1-abf18e253ead tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Request method failure captured: Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 HTTP/1.1 Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO3vjhlWCC-KStYbwXtPtKgmUxiFJSGxKAjzYJneeYvu2TYaJoOLi5OtwU7k80QSS1WrqHyT1mKhgyfgC0H8WVZEpRZWQQco04jn8A0SN4G0A9tH5pXctwq8sihhrhzFp0WaVH7n73ogm8zvNbh4DUPMFkLAQf4dmzlGoQZ8K1UTSog Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 356d731e34b24c9d8852516ae9141124 Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-VolumesActionsTest-1388464583 Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:38:22.354486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:38:22.356769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/356d731e34b24c9d8852516ae9141124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/356d731e34b24c9d8852516ae9141124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_356d731e34b24c9d8852516ae9141124"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/356d731e34b24c9d8852516ae9141124"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:38:22.356769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-VolumesActionsTest-1388464583 Sep 01 17:38:22.356769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 356d731e34b24c9d8852516ae9141124 Sep 01 17:38:22.356769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-VolumesActionsTest-1388464583 Sep 01 17:38:22.356769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-VolumesActionsTest-1388464583-project Sep 01 17:38:22.356769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:38:22.356769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:38:22.356769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: 75de510214004bbeab187d65bf178735 Sep 01 17:38:22.356769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-VolumesActionsTest-1388464583-project Sep 01 17:38:22.356769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:38:22.356769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance f95fb669-aa1f-43d4-af34-44437825c6e6 could not be found. Sep 01 17:38:22.356769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': 'f95fb669-aa1f-43d4-af34-44437825c6e6'} Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f95fb669-aa1f-43d4-af34-44437825c6e6 could not be found. Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:38:22.357598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f95fb669-aa1f-43d4-af34-44437825c6e6 could not be found. Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f95fb669-aa1f-43d4-af34-44437825c6e6 could not be found. Sep 01 17:38:22.359051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:22.361202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-989180a6-2a1a-4365-99c1-abf18e253ead tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Returning 404 to user: Instance f95fb669-aa1f-43d4-af34-44437825c6e6 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:38:22.362306 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-989180a6-2a1a-4365-99c1-abf18e253ead tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6" status: 404 len: 111 microversion: 2.1 time: 0.055227 Sep 01 17:38:22.363054 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 131/243] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:22 2022] GET /compute/v2.1/servers/f95fb669-aa1f-43d4-af34-44437825c6e6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:38:22.434208 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-cebd8a04-4487-4f12-a1a0-61b75fc3b118 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:22.450759 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-cebd8a04-4487-4f12-a1a0-61b75fc3b118 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1318 microversion: 2.1 time: 0.749515 Sep 01 17:38:22.454317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 113/244] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:21 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1318 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:22.592733 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1535956735", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "networks": [{"uuid": "bcc700fe-12c4-4b15-804f-2d8ef8a2dc7d"}]}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:22.669558 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.network.neutron [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] validate_networks() for [('bcc700fe-12c4-4b15-804f-2d8ef8a2dc7d', None, None, None, None, None)] {{(pid=127233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:38:23.195992 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-aa47174a-1376-44b4-903f-3f83e2641211 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:23.196973 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-aa47174a-1376-44b4-903f-3f83e2641211 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:23.209373 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa47174a-1376-44b4-903f-3f83e2641211 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:23.209373 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa47174a-1376-44b4-903f-3f83e2641211 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:23.210489 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa47174a-1376-44b4-903f-3f83e2641211 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:23.211210 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa47174a-1376-44b4-903f-3f83e2641211 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:23.214626 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa47174a-1376-44b4-903f-3f83e2641211 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:23.216752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa47174a-1376-44b4-903f-3f83e2641211 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:23.815548 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-aa47174a-1376-44b4-903f-3f83e2641211 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:23.824235 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-aa47174a-1376-44b4-903f-3f83e2641211 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.635093 Sep 01 17:38:23.846794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 114/245] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:23 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:23.849097 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Flavor limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:38:23.849683 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Image limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:38:23.850121 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Flavor pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:38:23.850716 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Image pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:38:23.851135 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:38:23.851619 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9637a553-1332-4d4c-b3ff-e6570aee1dc6 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:23.852357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9637a553-1332-4d4c-b3ff-e6570aee1dc6 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:23.868534 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9637a553-1332-4d4c-b3ff-e6570aee1dc6 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:23.869208 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9637a553-1332-4d4c-b3ff-e6570aee1dc6 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:23.869666 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9637a553-1332-4d4c-b3ff-e6570aee1dc6 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:23.870072 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:23.870366 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9637a553-1332-4d4c-b3ff-e6570aee1dc6 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:23.870574 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:23.870815 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9637a553-1332-4d4c-b3ff-e6570aee1dc6 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:23.871232 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9637a553-1332-4d4c-b3ff-e6570aee1dc6 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:23.873447 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:23.874312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:23.874809 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:23.877432 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:23.956493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Getting quotas for project 356d731e34b24c9d8852516ae9141124. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:38:23.963172 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Getting quotas for user 75de510214004bbeab187d65bf178735 and project 356d731e34b24c9d8852516ae9141124. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:38:23.981356 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Going to run 1 instances... {{(pid=127233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:38:23.984687 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:38:24.100295 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-db57258a-f5ec-4d4c-81da-235ea5e9d04d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.509558 Sep 01 17:38:24.103536 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 132/246] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:38:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:38:24.140403 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0321c4dc-c9b6-4741-9faa-af5b67b33954 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:24.141046 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0321c4dc-c9b6-4741-9faa-af5b67b33954 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:24.475743 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9637a553-1332-4d4c-b3ff-e6570aee1dc6 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:24.484556 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9637a553-1332-4d4c-b3ff-e6570aee1dc6 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1318 microversion: 2.1 time: 0.636576 Sep 01 17:38:24.487420 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 115/247] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:23 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1318 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:24.659152 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0321c4dc-c9b6-4741-9faa-af5b67b33954 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:24.676411 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0321c4dc-c9b6-4741-9faa-af5b67b33954 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1218 microversion: 2.1 time: 0.545677 Sep 01 17:38:24.677006 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 133/248] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:24 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1218 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:24.844681 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4b5f861e-2faf-413d-872d-a1677010a359 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:24.845296 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4b5f861e-2faf-413d-872d-a1677010a359 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:24.861110 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4b5f861e-2faf-413d-872d-a1677010a359 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:24.861646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4b5f861e-2faf-413d-872d-a1677010a359 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:24.862095 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4b5f861e-2faf-413d-872d-a1677010a359 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:24.862805 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4b5f861e-2faf-413d-872d-a1677010a359 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:24.863256 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4b5f861e-2faf-413d-872d-a1677010a359 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:24.863878 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4b5f861e-2faf-413d-872d-a1677010a359 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:25.116863 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4b5f861e-2faf-413d-872d-a1677010a359 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:25.126527 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4b5f861e-2faf-413d-872d-a1677010a359 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.285620 Sep 01 17:38:25.137884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 116/249] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:24 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:25.509520 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5d03ed64-a777-4c16-a8e5-a65785eb6b9d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:25.510155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5d03ed64-a777-4c16-a8e5-a65785eb6b9d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:25.531363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5d03ed64-a777-4c16-a8e5-a65785eb6b9d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:25.531896 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5d03ed64-a777-4c16-a8e5-a65785eb6b9d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:25.532883 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5d03ed64-a777-4c16-a8e5-a65785eb6b9d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:25.534413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5d03ed64-a777-4c16-a8e5-a65785eb6b9d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:25.536645 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5d03ed64-a777-4c16-a8e5-a65785eb6b9d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:25.537610 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5d03ed64-a777-4c16-a8e5-a65785eb6b9d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:25.706084 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8353e76c-4a2e-42eb-b858-bdefe5396ab1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:25.707087 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8353e76c-4a2e-42eb-b858-bdefe5396ab1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:25.716380 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8353e76c-4a2e-42eb-b858-bdefe5396ab1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:25.716995 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8353e76c-4a2e-42eb-b858-bdefe5396ab1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:25.717592 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8353e76c-4a2e-42eb-b858-bdefe5396ab1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:25.725971 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8353e76c-4a2e-42eb-b858-bdefe5396ab1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:25.725971 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8353e76c-4a2e-42eb-b858-bdefe5396ab1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:25.725971 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8353e76c-4a2e-42eb-b858-bdefe5396ab1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:26.196122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8353e76c-4a2e-42eb-b858-bdefe5396ab1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:26.213955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8353e76c-4a2e-42eb-b858-bdefe5396ab1 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1270 microversion: 2.1 time: 0.507776 Sep 01 17:38:26.215602 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 117/250] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:25 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1270 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:26.227630 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-78f610a3-039c-4069-bef6-0033f291bb00 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:26.234667 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-78f610a3-039c-4069-bef6-0033f291bb00 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:26.241395 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-78f610a3-039c-4069-bef6-0033f291bb00 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:26.242202 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-78f610a3-039c-4069-bef6-0033f291bb00 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:26.243730 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-78f610a3-039c-4069-bef6-0033f291bb00 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:26.244724 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-78f610a3-039c-4069-bef6-0033f291bb00 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:26.245541 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-78f610a3-039c-4069-bef6-0033f291bb00 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:26.246180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-78f610a3-039c-4069-bef6-0033f291bb00 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:26.490564 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5d03ed64-a777-4c16-a8e5-a65785eb6b9d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:26.506960 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5d03ed64-a777-4c16-a8e5-a65785eb6b9d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1318 microversion: 2.1 time: 1.001051 Sep 01 17:38:26.525073 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 134/251] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:25 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1318 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:26.746463 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-78f610a3-039c-4069-bef6-0033f291bb00 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:26.756374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-78f610a3-039c-4069-bef6-0033f291bb00 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.539524 Sep 01 17:38:26.757435 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 118/252] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:26 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:27.081859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-3f1e462c-b251-42f0-b78a-16b6bd314526 req-7d927786-9515-420e-bad5-105570f8b765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cacff4e-2af1-4eb3-af71-37d8570012a4", "name": "network-vif-plugged", "status": "completed", "tag": "4aabc61d-1a2d-4799-9322-795491f3c788"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:27.147868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-3f1e462c-b251-42f0-b78a-16b6bd314526 req-7d927786-9515-420e-bad5-105570f8b765 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:27.151131 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-3f1e462c-b251-42f0-b78a-16b6bd314526 req-7d927786-9515-420e-bad5-105570f8b765 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:27.153762 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-3f1e462c-b251-42f0-b78a-16b6bd314526 req-7d927786-9515-420e-bad5-105570f8b765 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:27.239880 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-fa34bfd9-e5b7-42e7-af31-ad24dcb70cd3 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:27.240403 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-3f1e462c-b251-42f0-b78a-16b6bd314526 req-7d927786-9515-420e-bad5-105570f8b765 service nova] Creating event network-vif-plugged:4aabc61d-1a2d-4799-9322-795491f3c788 for instance 5cacff4e-2af1-4eb3-af71-37d8570012a4 on hv-cinder-83976 Sep 01 17:38:27.240516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-fa34bfd9-e5b7-42e7-af31-ad24dcb70cd3 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:27.255822 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-3f1e462c-b251-42f0-b78a-16b6bd314526 req-7d927786-9515-420e-bad5-105570f8b765 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187273 Sep 01 17:38:27.256979 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 135/253] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:27.262037 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fa34bfd9-e5b7-42e7-af31-ad24dcb70cd3 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:27.262829 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fa34bfd9-e5b7-42e7-af31-ad24dcb70cd3 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:27.264023 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fa34bfd9-e5b7-42e7-af31-ad24dcb70cd3 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:27.265064 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fa34bfd9-e5b7-42e7-af31-ad24dcb70cd3 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:27.265703 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fa34bfd9-e5b7-42e7-af31-ad24dcb70cd3 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:27.266277 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fa34bfd9-e5b7-42e7-af31-ad24dcb70cd3 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:27.412678 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1807925256", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "networks": [{"uuid": "da5f2140-1185-44ef-89ed-d0fff147fb88"}]}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:27.468445 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-fa34bfd9-e5b7-42e7-af31-ad24dcb70cd3 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:27.490652 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-fa34bfd9-e5b7-42e7-af31-ad24dcb70cd3 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1276 microversion: 2.1 time: 0.254562 Sep 01 17:38:27.507044 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.network.neutron [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] validate_networks() for [('da5f2140-1185-44ef-89ed-d0fff147fb88', None, None, None, None, None)] {{(pid=127233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:38:27.512417 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 119/254] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:27 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1276 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:27.530456 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-99f2fe7b-dabb-4a5a-bad0-bdbfb697d879 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:27.531739 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-99f2fe7b-dabb-4a5a-bad0-bdbfb697d879 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:27.543282 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-99f2fe7b-dabb-4a5a-bad0-bdbfb697d879 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:27.544365 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-99f2fe7b-dabb-4a5a-bad0-bdbfb697d879 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:27.544995 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-99f2fe7b-dabb-4a5a-bad0-bdbfb697d879 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:27.545900 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-99f2fe7b-dabb-4a5a-bad0-bdbfb697d879 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:27.548407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-99f2fe7b-dabb-4a5a-bad0-bdbfb697d879 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:27.550021 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-99f2fe7b-dabb-4a5a-bad0-bdbfb697d879 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:28.207549 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-99f2fe7b-dabb-4a5a-bad0-bdbfb697d879 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:28.217619 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-99f2fe7b-dabb-4a5a-bad0-bdbfb697d879 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1318 microversion: 2.1 time: 0.691700 Sep 01 17:38:28.229664 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 120/255] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:27 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1318 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:28.229664 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-17469ea8-5f21-4342-82bc-64fc4b1eec7c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:28.229664 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-17469ea8-5f21-4342-82bc-64fc4b1eec7c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:28.233030 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-17469ea8-5f21-4342-82bc-64fc4b1eec7c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:28.233758 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-17469ea8-5f21-4342-82bc-64fc4b1eec7c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:28.234267 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-17469ea8-5f21-4342-82bc-64fc4b1eec7c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:28.235170 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-17469ea8-5f21-4342-82bc-64fc4b1eec7c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:28.235755 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-17469ea8-5f21-4342-82bc-64fc4b1eec7c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:28.237621 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-17469ea8-5f21-4342-82bc-64fc4b1eec7c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:28.577891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-17469ea8-5f21-4342-82bc-64fc4b1eec7c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:28.585654 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-17469ea8-5f21-4342-82bc-64fc4b1eec7c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.365890 Sep 01 17:38:28.602965 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 121/256] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:28 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:28.786919 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Flavor limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:38:28.787721 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Image limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:38:28.788405 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Flavor pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:38:28.788993 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Image pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:38:28.789477 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:38:28.814104 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:28.814594 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:28.815023 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:28.816014 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:28.817067 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:28.817606 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:28.844680 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Getting quotas for project 6695ac82241740f5ac5f73b4bcdac5f5. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:38:28.855666 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Getting quotas for user 66366eb7b7044786b23d08676c14670f and project 6695ac82241740f5ac5f73b4bcdac5f5. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:38:28.890682 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Going to run 1 instances... {{(pid=127233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:38:28.893486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:38:28.951802 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5f08a688-08d6-4fe9-9246-f2a3824c7c7a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.543794 Sep 01 17:38:28.952946 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 136/257] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:38:27 2022] POST /compute/v2.1/servers => generated 382 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:38:28.960568 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3749f2c0-a80b-4bb7-bb2e-7b74788bbd6e tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:28.962346 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3749f2c0-a80b-4bb7-bb2e-7b74788bbd6e tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:28.967434 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9e5b8998-c710-45ca-907d-8cbf61335cbb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Action: 'create', calling method: .version_select at 0x7f354a7cd0d0>, body: {"keypair": {"name": "tempest-keypair-1553554918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFgFKXnCu/hm49aJFM8CXnZsiyWZMsd9zc9NOl7o+jvWtuN95Gxc0prcmz75/WGsnt6ErnWNNx20hL8KNB8Jr/bN0sqBaCDjc+epm1C5ehVYa3TVGIaUjLf2f10PX1n6g=="}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:28.970945 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3749f2c0-a80b-4bb7-bb2e-7b74788bbd6e tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:28.971448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3749f2c0-a80b-4bb7-bb2e-7b74788bbd6e tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:28.971964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3749f2c0-a80b-4bb7-bb2e-7b74788bbd6e tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:28.972909 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3749f2c0-a80b-4bb7-bb2e-7b74788bbd6e tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:28.973403 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3749f2c0-a80b-4bb7-bb2e-7b74788bbd6e tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:28.973871 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3749f2c0-a80b-4bb7-bb2e-7b74788bbd6e tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:29.052249 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-9e5b8998-c710-45ca-907d-8cbf61335cbb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for project 1cf7216d5c904b24a9665755720cf287. Resources: {'key_pairs'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:38:29.067400 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-9e5b8998-c710-45ca-907d-8cbf61335cbb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for user d3848643d2c44951b78814ccf7d504af and project 1cf7216d5c904b24a9665755720cf287. Resources: {'key_pairs'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:38:29.176029 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9e5b8998-c710-45ca-907d-8cbf61335cbb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.571753 Sep 01 17:38:29.176638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 122/258] 10.222.0.100 () {60 vars in 1164 bytes} [Thu Sep 1 17:38:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:29.192554 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8b7fce94-a1c8-4918-8839-f4afd213dbca tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:29.195754 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8b7fce94-a1c8-4918-8839-f4afd213dbca tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:29.284281 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3749f2c0-a80b-4bb7-bb2e-7b74788bbd6e tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:29.303590 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3749f2c0-a80b-4bb7-bb2e-7b74788bbd6e tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1318 microversion: 2.1 time: 0.343734 Sep 01 17:38:29.311538 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 137/259] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:28 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:29.338387 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5a6dd440-9467-4a33-8553-2dd06ecaa084 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:29.339000 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5a6dd440-9467-4a33-8553-2dd06ecaa084 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:29.350574 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5a6dd440-9467-4a33-8553-2dd06ecaa084 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:29.351195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5a6dd440-9467-4a33-8553-2dd06ecaa084 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:29.351639 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5a6dd440-9467-4a33-8553-2dd06ecaa084 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:29.353159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5a6dd440-9467-4a33-8553-2dd06ecaa084 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:29.353781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5a6dd440-9467-4a33-8553-2dd06ecaa084 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:29.354211 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5a6dd440-9467-4a33-8553-2dd06ecaa084 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:29.430839 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8b7fce94-a1c8-4918-8839-f4afd213dbca tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:29.442487 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8b7fce94-a1c8-4918-8839-f4afd213dbca tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1223 microversion: 2.1 time: 0.264638 Sep 01 17:38:29.443997 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 123/260] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:29 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1223 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:29.623309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-0056fb1e-1b94-4f66-a518-377215dada45 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:29.625046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-0056fb1e-1b94-4f66-a518-377215dada45 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:29.632974 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0056fb1e-1b94-4f66-a518-377215dada45 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:29.635085 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0056fb1e-1b94-4f66-a518-377215dada45 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:29.636214 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0056fb1e-1b94-4f66-a518-377215dada45 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:29.639652 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0056fb1e-1b94-4f66-a518-377215dada45 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:29.642465 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0056fb1e-1b94-4f66-a518-377215dada45 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:29.646591 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0056fb1e-1b94-4f66-a518-377215dada45 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:29.675882 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:29.931517 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5a6dd440-9467-4a33-8553-2dd06ecaa084 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:29.940308 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5a6dd440-9467-4a33-8553-2dd06ecaa084 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1468 microversion: 2.1 time: 0.625664 Sep 01 17:38:29.940900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 138/261] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:29 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1468 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:30.009665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2b8b272c-38b6-4666-a0e0-ff831163c05f tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:30.010171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2b8b272c-38b6-4666-a0e0-ff831163c05f tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:30.022813 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2b8b272c-38b6-4666-a0e0-ff831163c05f tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:30.034437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2b8b272c-38b6-4666-a0e0-ff831163c05f tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:30.035199 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2b8b272c-38b6-4666-a0e0-ff831163c05f tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:30.036128 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2b8b272c-38b6-4666-a0e0-ff831163c05f tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:30.036754 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2b8b272c-38b6-4666-a0e0-ff831163c05f tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:30.037682 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2b8b272c-38b6-4666-a0e0-ff831163c05f tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:30.077057 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2b8b272c-38b6-4666-a0e0-ff831163c05f tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Going to try to terminate instance {{(pid=127233) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:38:30.180648 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:30.199459 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2b8b272c-38b6-4666-a0e0-ff831163c05f tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 204 len: 0 microversion: 2.1 time: 0.194469 Sep 01 17:38:30.199459 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 139/262] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:38:30 2022] DELETE /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:38:30.208714 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e520e890-ebdd-4b49-84d5-c465dc191c7d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:30.210017 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e520e890-ebdd-4b49-84d5-c465dc191c7d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:30.221175 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e520e890-ebdd-4b49-84d5-c465dc191c7d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:30.221332 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e520e890-ebdd-4b49-84d5-c465dc191c7d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:30.222421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e520e890-ebdd-4b49-84d5-c465dc191c7d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:30.224810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e520e890-ebdd-4b49-84d5-c465dc191c7d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:30.225858 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e520e890-ebdd-4b49-84d5-c465dc191c7d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:30.226601 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e520e890-ebdd-4b49-84d5-c465dc191c7d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:30.246500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-0056fb1e-1b94-4f66-a518-377215dada45 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:30.278626 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-0056fb1e-1b94-4f66-a518-377215dada45 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.671615 Sep 01 17:38:30.279360 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 124/263] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:29 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:30.335752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d875a28e-a531-40e4-8292-c8254889f3c5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:30.337030 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d875a28e-a531-40e4-8292-c8254889f3c5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:30.346592 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d875a28e-a531-40e4-8292-c8254889f3c5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:30.348792 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d875a28e-a531-40e4-8292-c8254889f3c5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:30.350086 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d875a28e-a531-40e4-8292-c8254889f3c5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:30.351605 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d875a28e-a531-40e4-8292-c8254889f3c5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:30.352825 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d875a28e-a531-40e4-8292-c8254889f3c5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:30.353631 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d875a28e-a531-40e4-8292-c8254889f3c5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:30.572096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e520e890-ebdd-4b49-84d5-c465dc191c7d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:30.606981 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e520e890-ebdd-4b49-84d5-c465dc191c7d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1474 microversion: 2.1 time: 0.402017 Sep 01 17:38:30.625488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 140/264] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:30 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1474 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:30.625488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d7a9783f-49c9-498d-b192-bb695fb1e5e8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:30.625488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d7a9783f-49c9-498d-b192-bb695fb1e5e8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:30.638701 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d7a9783f-49c9-498d-b192-bb695fb1e5e8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:30.639181 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d7a9783f-49c9-498d-b192-bb695fb1e5e8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:30.639623 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d7a9783f-49c9-498d-b192-bb695fb1e5e8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:30.640430 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d7a9783f-49c9-498d-b192-bb695fb1e5e8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:30.640901 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d7a9783f-49c9-498d-b192-bb695fb1e5e8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:30.641329 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d7a9783f-49c9-498d-b192-bb695fb1e5e8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:30.792282 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d7a9783f-49c9-498d-b192-bb695fb1e5e8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:30.804302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d875a28e-a531-40e4-8292-c8254889f3c5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:30.808930 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d7a9783f-49c9-498d-b192-bb695fb1e5e8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1219 microversion: 2.1 time: 0.184167 Sep 01 17:38:30.809646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 141/265] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:30 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1219 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:30.827309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d875a28e-a531-40e4-8292-c8254889f3c5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1318 microversion: 2.1 time: 0.496413 Sep 01 17:38:30.828242 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 125/266] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:30 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:31.067345 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-1e9b2c7d-9440-49d9-a556-e2ee901e9b7e req-9dfece04-8e5e-4c2e-a83a-7bb0c06d8e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b3dd05-1820-4e87-a408-322f5c184899", "tag": "c5b87571-eded-4c16-9cfa-859bef9322d2"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:31.090674 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-1e9b2c7d-9440-49d9-a556-e2ee901e9b7e req-9dfece04-8e5e-4c2e-a83a-7bb0c06d8e28 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:31.091160 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-1e9b2c7d-9440-49d9-a556-e2ee901e9b7e req-9dfece04-8e5e-4c2e-a83a-7bb0c06d8e28 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:31.091596 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-1e9b2c7d-9440-49d9-a556-e2ee901e9b7e req-9dfece04-8e5e-4c2e-a83a-7bb0c06d8e28 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:31.110202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-1e9b2c7d-9440-49d9-a556-e2ee901e9b7e req-9dfece04-8e5e-4c2e-a83a-7bb0c06d8e28 service nova] Creating event network-changed:c5b87571-eded-4c16-9cfa-859bef9322d2 for instance 22b3dd05-1820-4e87-a408-322f5c184899 on hv-cinder-83976 Sep 01 17:38:31.120059 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-1e9b2c7d-9440-49d9-a556-e2ee901e9b7e req-9dfece04-8e5e-4c2e-a83a-7bb0c06d8e28 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056377 Sep 01 17:38:31.125470 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 142/267] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:31.303309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e93b9bf4-cf2d-40a4-9688-119a81655971 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:31.310651 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e93b9bf4-cf2d-40a4-9688-119a81655971 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:31.329716 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e93b9bf4-cf2d-40a4-9688-119a81655971 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:31.332452 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e93b9bf4-cf2d-40a4-9688-119a81655971 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:31.333889 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e93b9bf4-cf2d-40a4-9688-119a81655971 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:31.335180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e93b9bf4-cf2d-40a4-9688-119a81655971 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:31.335809 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e93b9bf4-cf2d-40a4-9688-119a81655971 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:31.337916 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e93b9bf4-cf2d-40a4-9688-119a81655971 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:31.596689 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e93b9bf4-cf2d-40a4-9688-119a81655971 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:31.608983 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e93b9bf4-cf2d-40a4-9688-119a81655971 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.310375 Sep 01 17:38:31.624112 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 126/268] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:31 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:31.635232 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-834a0554-3c00-4bdd-b8ca-4867830b145c tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:31.636049 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-834a0554-3c00-4bdd-b8ca-4867830b145c tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:31.643036 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-834a0554-3c00-4bdd-b8ca-4867830b145c tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:31.644022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-834a0554-3c00-4bdd-b8ca-4867830b145c tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:31.644921 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-834a0554-3c00-4bdd-b8ca-4867830b145c tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:31.645977 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-834a0554-3c00-4bdd-b8ca-4867830b145c tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:31.646646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-834a0554-3c00-4bdd-b8ca-4867830b145c tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:31.647274 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-834a0554-3c00-4bdd-b8ca-4867830b145c tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:31.831557 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-98f9930d-0825-4cb9-99c7-fffb39ffe0cf tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:31.832944 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-98f9930d-0825-4cb9-99c7-fffb39ffe0cf tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:31.844619 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-98f9930d-0825-4cb9-99c7-fffb39ffe0cf tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:31.845345 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-98f9930d-0825-4cb9-99c7-fffb39ffe0cf tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:31.845892 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-98f9930d-0825-4cb9-99c7-fffb39ffe0cf tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:31.846893 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-98f9930d-0825-4cb9-99c7-fffb39ffe0cf tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:31.847599 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-98f9930d-0825-4cb9-99c7-fffb39ffe0cf tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:31.848246 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-98f9930d-0825-4cb9-99c7-fffb39ffe0cf tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:31.855209 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-834a0554-3c00-4bdd-b8ca-4867830b145c tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:31.868785 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-834a0554-3c00-4bdd-b8ca-4867830b145c tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1474 microversion: 2.1 time: 0.238959 Sep 01 17:38:31.882106 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 143/269] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:31 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1474 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:31.893283 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-05851146-8208-45d2-857c-8d6540ea2206 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:31.893968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-05851146-8208-45d2-857c-8d6540ea2206 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:31.901142 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05851146-8208-45d2-857c-8d6540ea2206 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:31.902029 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05851146-8208-45d2-857c-8d6540ea2206 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:31.902666 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05851146-8208-45d2-857c-8d6540ea2206 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:31.903598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05851146-8208-45d2-857c-8d6540ea2206 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:31.904280 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05851146-8208-45d2-857c-8d6540ea2206 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:31.904908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05851146-8208-45d2-857c-8d6540ea2206 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:31.948550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-98f9930d-0825-4cb9-99c7-fffb39ffe0cf tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:31.965133 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-98f9930d-0825-4cb9-99c7-fffb39ffe0cf tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1275 microversion: 2.1 time: 0.138952 Sep 01 17:38:31.971406 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 127/270] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:31 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1275 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:32.090961 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-862968804", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "633c7f8a-adb2-49f1-988f-caf4bcddf2dc"}], "security_groups": [{"name": "tempest-securitygroup--2066017482"}], "key_name": "tempest-keypair-1553554918", "user_data": "}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:32.183231 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-05851146-8208-45d2-857c-8d6540ea2206 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:32.205479 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-05851146-8208-45d2-857c-8d6540ea2206 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1318 microversion: 2.1 time: 0.322098 Sep 01 17:38:32.206427 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 144/271] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:31 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:32.656340 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8d15f8e8-28b8-40b9-a8a0-b88a221cbc35 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:32.657598 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.network.neutron [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] validate_networks() for [('633c7f8a-adb2-49f1-988f-caf4bcddf2dc', None, None, None, None, None)] {{(pid=127232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:38:32.660552 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8d15f8e8-28b8-40b9-a8a0-b88a221cbc35 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:32.669080 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8d15f8e8-28b8-40b9-a8a0-b88a221cbc35 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:32.669838 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8d15f8e8-28b8-40b9-a8a0-b88a221cbc35 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:32.670725 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8d15f8e8-28b8-40b9-a8a0-b88a221cbc35 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:32.671635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8d15f8e8-28b8-40b9-a8a0-b88a221cbc35 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:32.672298 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8d15f8e8-28b8-40b9-a8a0-b88a221cbc35 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:32.672899 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8d15f8e8-28b8-40b9-a8a0-b88a221cbc35 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:33.207175 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8d15f8e8-28b8-40b9-a8a0-b88a221cbc35 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:33.220012 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8d15f8e8-28b8-40b9-a8a0-b88a221cbc35 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.591425 Sep 01 17:38:33.240267 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 145/272] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:32 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:33.247674 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0316a5b8-8bee-410f-b555-60219649ed5d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:33.248560 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0316a5b8-8bee-410f-b555-60219649ed5d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:33.260297 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0316a5b8-8bee-410f-b555-60219649ed5d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:33.261134 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0316a5b8-8bee-410f-b555-60219649ed5d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:33.261812 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0316a5b8-8bee-410f-b555-60219649ed5d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:33.263147 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0316a5b8-8bee-410f-b555-60219649ed5d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:33.263747 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0316a5b8-8bee-410f-b555-60219649ed5d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:33.264243 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0316a5b8-8bee-410f-b555-60219649ed5d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:33.450813 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0316a5b8-8bee-410f-b555-60219649ed5d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:33.460100 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0316a5b8-8bee-410f-b555-60219649ed5d tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1432 microversion: 2.1 time: 0.216919 Sep 01 17:38:33.483687 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 146/273] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:33 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1432 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:33.489114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a23a4204-1822-42b1-8524-6539317d779b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:33.490061 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a23a4204-1822-42b1-8524-6539317d779b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:33.497121 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a23a4204-1822-42b1-8524-6539317d779b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:33.497916 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a23a4204-1822-42b1-8524-6539317d779b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:33.498592 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a23a4204-1822-42b1-8524-6539317d779b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:33.499565 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a23a4204-1822-42b1-8524-6539317d779b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:33.500260 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a23a4204-1822-42b1-8524-6539317d779b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:33.500958 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a23a4204-1822-42b1-8524-6539317d779b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:33.506211 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:33.646403 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a23a4204-1822-42b1-8524-6539317d779b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:33.666573 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a23a4204-1822-42b1-8524-6539317d779b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1275 microversion: 2.1 time: 0.179172 Sep 01 17:38:33.667213 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 147/274] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:33 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:33.677299 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7f0e97ad-c1e0-42ad-8260-026c4941b85a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:33.681756 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7f0e97ad-c1e0-42ad-8260-026c4941b85a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:33.697477 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f0e97ad-c1e0-42ad-8260-026c4941b85a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:33.701311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f0e97ad-c1e0-42ad-8260-026c4941b85a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:33.702097 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f0e97ad-c1e0-42ad-8260-026c4941b85a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:33.703203 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f0e97ad-c1e0-42ad-8260-026c4941b85a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:33.704301 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f0e97ad-c1e0-42ad-8260-026c4941b85a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:33.704954 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7f0e97ad-c1e0-42ad-8260-026c4941b85a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:33.883889 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Flavor limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:38:33.885568 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Image limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:38:33.886722 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Flavor pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:38:33.887895 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Image pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:38:33.889133 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:38:33.905641 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:33.906484 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:33.907852 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:33.909707 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:33.910795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:33.911802 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:33.938908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7f0e97ad-c1e0-42ad-8260-026c4941b85a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:33.949780 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7f0e97ad-c1e0-42ad-8260-026c4941b85a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1318 microversion: 2.1 time: 0.281249 Sep 01 17:38:33.951427 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for project 1cf7216d5c904b24a9665755720cf287. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:38:33.960449 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for user d3848643d2c44951b78814ccf7d504af and project 1cf7216d5c904b24a9665755720cf287. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:38:33.964344 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 148/275] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:33 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:33.969353 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-7ead2abd-288e-4795-8791-92131361c6e9 req-e917094c-11e6-4298-8adb-1bb078ab7c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cacff4e-2af1-4eb3-af71-37d8570012a4", "name": "network-vif-deleted", "tag": "4aabc61d-1a2d-4799-9322-795491f3c788"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:33.980608 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:33.980882 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-7ead2abd-288e-4795-8791-92131361c6e9 req-e917094c-11e6-4298-8adb-1bb078ab7c2f service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:33.981106 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-7ead2abd-288e-4795-8791-92131361c6e9 req-e917094c-11e6-4298-8adb-1bb078ab7c2f service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:33.982008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-7ead2abd-288e-4795-8791-92131361c6e9 req-e917094c-11e6-4298-8adb-1bb078ab7c2f service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:33.988655 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Going to run 1 instances... {{(pid=127232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:38:33.994244 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:38:33.997487 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-7ead2abd-288e-4795-8791-92131361c6e9 req-e917094c-11e6-4298-8adb-1bb078ab7c2f service nova] Creating event network-vif-deleted:4aabc61d-1a2d-4799-9322-795491f3c788 for instance 5cacff4e-2af1-4eb3-af71-37d8570012a4 on hv-cinder-83976 Sep 01 17:38:34.002863 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-7ead2abd-288e-4795-8791-92131361c6e9 req-e917094c-11e6-4298-8adb-1bb078ab7c2f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037211 Sep 01 17:38:34.004104 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 149/276] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:34.117914 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2e449076-f4da-4c90-b538-f7bd461b9070 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.029717 Sep 01 17:38:34.132251 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 128/277] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:38:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 2047 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:38:34.137227 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f0c74cbf-b954-470e-aaf4-a64372d57077 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:34.138528 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f0c74cbf-b954-470e-aaf4-a64372d57077 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:34.245783 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f0c74cbf-b954-470e-aaf4-a64372d57077 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:34.250891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f644f24a-538f-45c9-b16f-71864f5f4e9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:34.252004 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f644f24a-538f-45c9-b16f-71864f5f4e9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:34.257908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f0c74cbf-b954-470e-aaf4-a64372d57077 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1245 microversion: 2.1 time: 0.121776 Sep 01 17:38:34.259748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 150/278] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:34 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1245 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:34.267457 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f644f24a-538f-45c9-b16f-71864f5f4e9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.270502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f644f24a-538f-45c9-b16f-71864f5f4e9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.273556 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f644f24a-538f-45c9-b16f-71864f5f4e9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:34.279333 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f644f24a-538f-45c9-b16f-71864f5f4e9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.280184 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f644f24a-538f-45c9-b16f-71864f5f4e9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.280872 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f644f24a-538f-45c9-b16f-71864f5f4e9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:34.491413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:34.493224 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:34.514776 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.515285 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.515722 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:34.516435 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.516884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.533562 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:34.631035 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.634879 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.636508 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:34.636990 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lazy-loading 'fault' on Instance uuid 5cacff4e-2af1-4eb3-af71-37d8570012a4 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:34.674143 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f644f24a-538f-45c9-b16f-71864f5f4e9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:34.694085 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f644f24a-538f-45c9-b16f-71864f5f4e9c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1505 microversion: 2.1 time: 0.453453 Sep 01 17:38:34.713924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 129/279] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:34 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:34.713924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f752d6e8-06df-4be9-ab46-4339b924e4b9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:34.713924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f752d6e8-06df-4be9-ab46-4339b924e4b9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:34.719099 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f752d6e8-06df-4be9-ab46-4339b924e4b9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.729641 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f752d6e8-06df-4be9-ab46-4339b924e4b9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.730576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f752d6e8-06df-4be9-ab46-4339b924e4b9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:34.732682 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f752d6e8-06df-4be9-ab46-4339b924e4b9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.735852 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f752d6e8-06df-4be9-ab46-4339b924e4b9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.737604 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f752d6e8-06df-4be9-ab46-4339b924e4b9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:34.764997 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e0a450471043678b080515896d0f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8643f179145e4e1aba7994ada9821a30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:34.776768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2072ad21-009d-441e-9ba8-9975ab117c62 tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 200 len: 1308 microversion: 2.1 time: 0.290435 Sep 01 17:38:34.793524 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 151/280] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:34 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 1308 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:34.804634 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c2343a22-f333-4f8f-aec0-f9cca26cf0ed tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b82dff7-74fe-430d-b8fa-7b778e35305c"}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:34.809345 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c2343a22-f333-4f8f-aec0-f9cca26cf0ed tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:34.819256 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c2343a22-f333-4f8f-aec0-f9cca26cf0ed tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.820020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c2343a22-f333-4f8f-aec0-f9cca26cf0ed tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.822467 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c2343a22-f333-4f8f-aec0-f9cca26cf0ed tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:34.825097 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c2343a22-f333-4f8f-aec0-f9cca26cf0ed tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.826963 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c2343a22-f333-4f8f-aec0-f9cca26cf0ed tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.828685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c2343a22-f333-4f8f-aec0-f9cca26cf0ed tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:34.880257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-c2343a22-f333-4f8f-aec0-f9cca26cf0ed tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] HTTP exception thrown: Cannot 'attach_volume' instance 0f637e8e-d6ed-4516-b57d-48174aa65926 while it is in vm_state rescued Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c2343a22-f333-4f8f-aec0-f9cca26cf0ed tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Request method failure captured: Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: POST /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926/os-volume_attachments HTTP/1.1 Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 74 Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2m8zyf1MdfI9Plug8mrFjRApjQ5c-8jQisg1PVk0tj5vFsUELO_1M1udUcyP_UxAfWvOWoJ8fDtqa8LTzrnjXG6uPV0irrnSvS-1H3XCvA0zw3nvSo7ARUEiib2-x1XXV_v7wdYFSh1m3JfZWwThjo3uq-lxNxGev-IFpfAVdzDqI Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: b01df46ff9744c2f830459547d7e4dd6 Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:38:34.892704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:38:34.894278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:38:34.894278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:38:34.894278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: b01df46ff9744c2f830459547d7e4dd6 Sep 01 17:38:34.894278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:38:34.894278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-ServerRescueNegativeTestJSON-1908064911-project Sep 01 17:38:34.894278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:38:34.894278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:38:34.894278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: 5647214c5b3f438eb3ef1ddc14153d9e Sep 01 17:38:34.894278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1908064911-project Sep 01 17:38:34.894278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Sep 01 17:38:34.894278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {"volumeAttachment": {"volumeId": "7b82dff7-74fe-430d-b8fa-7b778e35305c"}} Sep 01 17:38:34.894278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Cannot 'attach_volume' instance 0f637e8e-d6ed-4516-b57d-48174aa65926 while it is in vm_state rescued Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'server_id': '0f637e8e-d6ed-4516-b57d-48174aa65926', 'body': {'volumeAttachment': {'volumeId': '7b82dff7-74fe-430d-b8fa-7b778e35305c'}}} Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f637e8e-d6ed-4516-b57d-48174aa65926 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:38:34.895022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0f637e8e-d6ed-4516-b57d-48174aa65926 while it is in vm_state rescued Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:34.896244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:34.897294 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:38:34.897294 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:38:34.897294 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0f637e8e-d6ed-4516-b57d-48174aa65926 while it is in vm_state rescued Sep 01 17:38:34.897294 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:34.909729 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c2343a22-f333-4f8f-aec0-f9cca26cf0ed tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Returning 409 to user: Cannot 'attach_volume' instance 0f637e8e-d6ed-4516-b57d-48174aa65926 while it is in vm_state rescued {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:38:34.910832 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-c2343a22-f333-4f8f-aec0-f9cca26cf0ed tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "POST /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.115998 Sep 01 17:38:34.916953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 152/281] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:38:34 2022] POST /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926/os-volume_attachments => generated 152 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 17:38:34.921107 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f752d6e8-06df-4be9-ab46-4339b924e4b9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:34.923163 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-15b06040-9c88-4a12-8165-ad5a70317c84 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:34.923890 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-15b06040-9c88-4a12-8165-ad5a70317c84 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:34.933616 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f752d6e8-06df-4be9-ab46-4339b924e4b9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1281 microversion: 2.1 time: 0.229978 Sep 01 17:38:34.934427 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 130/282] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:34 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1281 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:34.938895 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15b06040-9c88-4a12-8165-ad5a70317c84 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.939712 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15b06040-9c88-4a12-8165-ad5a70317c84 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.940369 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15b06040-9c88-4a12-8165-ad5a70317c84 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:34.941512 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15b06040-9c88-4a12-8165-ad5a70317c84 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.943745 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15b06040-9c88-4a12-8165-ad5a70317c84 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.947318 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15b06040-9c88-4a12-8165-ad5a70317c84 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:34.972028 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d696c68b-c26b-4ca4-881d-923153e0038d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:34.972644 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d696c68b-c26b-4ca4-881d-923153e0038d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:34.989680 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d696c68b-c26b-4ca4-881d-923153e0038d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.990353 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d696c68b-c26b-4ca4-881d-923153e0038d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.990589 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d696c68b-c26b-4ca4-881d-923153e0038d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:34.991471 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d696c68b-c26b-4ca4-881d-923153e0038d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.992072 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d696c68b-c26b-4ca4-881d-923153e0038d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.993512 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d696c68b-c26b-4ca4-881d-923153e0038d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:35.181470 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-15b06040-9c88-4a12-8165-ad5a70317c84 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "POST /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926/action" status: 202 len: 0 microversion: 2.1 time: 0.244961 Sep 01 17:38:35.186144 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 153/283] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:38:34 2022] POST /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:38:35.232942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-38150372-2594-4023-bbed-9d8cd5668ded tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:35.235079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-38150372-2594-4023-bbed-9d8cd5668ded tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:35.270447 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-38150372-2594-4023-bbed-9d8cd5668ded tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:35.276764 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-38150372-2594-4023-bbed-9d8cd5668ded tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:35.277933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-38150372-2594-4023-bbed-9d8cd5668ded tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:35.279606 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-38150372-2594-4023-bbed-9d8cd5668ded tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:35.280317 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-38150372-2594-4023-bbed-9d8cd5668ded tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:35.281274 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-38150372-2594-4023-bbed-9d8cd5668ded tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:35.686765 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d696c68b-c26b-4ca4-881d-923153e0038d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:35.696883 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d696c68b-c26b-4ca4-881d-923153e0038d tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1318 microversion: 2.1 time: 0.728386 Sep 01 17:38:35.713673 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 131/284] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:34 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1318 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:35.713673 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cca2074f-4182-49f0-ba52-f15c2fdf3b5a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:35.713673 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-cca2074f-4182-49f0-ba52-f15c2fdf3b5a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:35.713673 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cca2074f-4182-49f0-ba52-f15c2fdf3b5a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:35.714179 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cca2074f-4182-49f0-ba52-f15c2fdf3b5a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:35.714179 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cca2074f-4182-49f0-ba52-f15c2fdf3b5a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:35.714703 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cca2074f-4182-49f0-ba52-f15c2fdf3b5a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:35.715380 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cca2074f-4182-49f0-ba52-f15c2fdf3b5a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:35.715977 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cca2074f-4182-49f0-ba52-f15c2fdf3b5a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:35.753364 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-38150372-2594-4023-bbed-9d8cd5668ded tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:35.762540 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-38150372-2594-4023-bbed-9d8cd5668ded tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1513 microversion: 2.1 time: 0.564485 Sep 01 17:38:35.775883 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 154/285] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:35 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1513 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:35.799794 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1e42b92a-8eeb-41ed-bd2c-0fe26b6fb5ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:35.800675 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-1e42b92a-8eeb-41ed-bd2c-0fe26b6fb5ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] [instance: 5cacff4e-2af1-4eb3-af71-37d8570012a4] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:35.807595 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1e42b92a-8eeb-41ed-bd2c-0fe26b6fb5ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:35.808099 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1e42b92a-8eeb-41ed-bd2c-0fe26b6fb5ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:35.808525 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1e42b92a-8eeb-41ed-bd2c-0fe26b6fb5ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:35.809407 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1e42b92a-8eeb-41ed-bd2c-0fe26b6fb5ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:35.809900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1e42b92a-8eeb-41ed-bd2c-0fe26b6fb5ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:35.810323 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1e42b92a-8eeb-41ed-bd2c-0fe26b6fb5ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:35.827405 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-1e42b92a-8eeb-41ed-bd2c-0fe26b6fb5ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] HTTP exception thrown: Instance 5cacff4e-2af1-4eb3-af71-37d8570012a4 could not be found. Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1e42b92a-8eeb-41ed-bd2c-0fe26b6fb5ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Request method failure captured: Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 HTTP/1.1 Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO397kJI2VlcdLvB9isdxEmeQKjYQceNKhgCLtfMaE6tkiOh5Rwt1VZ_CvG_m4MfO6Zy8KD2IvoB7jatARwqFo8BXn05R7q1P95pcmuDNYoYgUNOJcf-GVzpF8KdQQOzFKcREBrp2JXkDD9cqQ4qQX8oJJaoV2g_2n7RJ1ORcrnBbWQ Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 8643f179145e4e1aba7994ada9821a30 Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-VolumesNegativeTest-1672754339 Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:38:35.829368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:38:35.830994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8643f179145e4e1aba7994ada9821a30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8643f179145e4e1aba7994ada9821a30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8643f179145e4e1aba7994ada9821a30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8643f179145e4e1aba7994ada9821a30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:38:35.830994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-VolumesNegativeTest-1672754339 Sep 01 17:38:35.830994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 8643f179145e4e1aba7994ada9821a30 Sep 01 17:38:35.830994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-VolumesNegativeTest-1672754339 Sep 01 17:38:35.830994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-VolumesNegativeTest-1672754339-project Sep 01 17:38:35.830994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:38:35.830994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:38:35.830994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: c2e0a450471043678b080515896d0f50 Sep 01 17:38:35.830994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-VolumesNegativeTest-1672754339-project Sep 01 17:38:35.830994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:38:35.830994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 5cacff4e-2af1-4eb3-af71-37d8570012a4 could not be found. Sep 01 17:38:35.830994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '5cacff4e-2af1-4eb3-af71-37d8570012a4'} Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cacff4e-2af1-4eb3-af71-37d8570012a4 could not be found. Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:38:35.831864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cacff4e-2af1-4eb3-af71-37d8570012a4 could not be found. Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cacff4e-2af1-4eb3-af71-37d8570012a4 could not be found. Sep 01 17:38:35.833171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:38:35.835057 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1e42b92a-8eeb-41ed-bd2c-0fe26b6fb5ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] Returning 404 to user: Instance 5cacff4e-2af1-4eb3-af71-37d8570012a4 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:38:35.836585 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1e42b92a-8eeb-41ed-bd2c-0fe26b6fb5ab tempest-VolumesNegativeTest-1672754339 tempest-VolumesNegativeTest-1672754339-project] 10.222.0.100 "GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4" status: 404 len: 111 microversion: 2.1 time: 0.040338 Sep 01 17:38:35.837140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 155/286] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:35 2022] GET /compute/v2.1/servers/5cacff4e-2af1-4eb3-af71-37d8570012a4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 17:38:35.844151 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-cca2074f-4182-49f0-ba52-f15c2fdf3b5a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:35.853298 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-cca2074f-4182-49f0-ba52-f15c2fdf3b5a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1297 microversion: 2.1 time: 0.154320 Sep 01 17:38:35.859711 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 132/287] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:35 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1297 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:35.968654 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4bbd4fc4-68b8-4529-95a0-e2bcc8026190 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:35.969417 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4bbd4fc4-68b8-4529-95a0-e2bcc8026190 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:35.976083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4bbd4fc4-68b8-4529-95a0-e2bcc8026190 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:35.976708 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4bbd4fc4-68b8-4529-95a0-e2bcc8026190 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:35.977311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4bbd4fc4-68b8-4529-95a0-e2bcc8026190 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:35.978058 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4bbd4fc4-68b8-4529-95a0-e2bcc8026190 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:35.978830 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4bbd4fc4-68b8-4529-95a0-e2bcc8026190 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:35.979496 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4bbd4fc4-68b8-4529-95a0-e2bcc8026190 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:36.254150 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4bbd4fc4-68b8-4529-95a0-e2bcc8026190 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:36.260993 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4bbd4fc4-68b8-4529-95a0-e2bcc8026190 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.296693 Sep 01 17:38:36.265888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 156/288] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:35 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:36.728796 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6d3e2879-6590-46fd-81f1-42d7f1e1e116 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:36.729916 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6d3e2879-6590-46fd-81f1-42d7f1e1e116 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:36.749737 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6d3e2879-6590-46fd-81f1-42d7f1e1e116 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:36.749942 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6d3e2879-6590-46fd-81f1-42d7f1e1e116 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:36.750586 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6d3e2879-6590-46fd-81f1-42d7f1e1e116 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:36.751092 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6d3e2879-6590-46fd-81f1-42d7f1e1e116 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:36.754315 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6d3e2879-6590-46fd-81f1-42d7f1e1e116 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:36.754711 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6d3e2879-6590-46fd-81f1-42d7f1e1e116 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:36.783873 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3046a6f6-30d4-4dcc-a9a9-f249c1b67803 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:36.785053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3046a6f6-30d4-4dcc-a9a9-f249c1b67803 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:36.805719 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3046a6f6-30d4-4dcc-a9a9-f249c1b67803 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:36.806215 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3046a6f6-30d4-4dcc-a9a9-f249c1b67803 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:36.806648 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3046a6f6-30d4-4dcc-a9a9-f249c1b67803 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:36.807355 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3046a6f6-30d4-4dcc-a9a9-f249c1b67803 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:36.807806 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3046a6f6-30d4-4dcc-a9a9-f249c1b67803 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:36.808226 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3046a6f6-30d4-4dcc-a9a9-f249c1b67803 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:37.231569 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3046a6f6-30d4-4dcc-a9a9-f249c1b67803 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:37.246353 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3046a6f6-30d4-4dcc-a9a9-f249c1b67803 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1513 microversion: 2.1 time: 0.463077 Sep 01 17:38:37.247750 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 157/289] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:36 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1513 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:37.257675 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-9a8f9b4e-b2d0-4b02-9e86-505ee78eedfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:37.258350 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-9a8f9b4e-b2d0-4b02-9e86-505ee78eedfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:37.277920 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a8f9b4e-b2d0-4b02-9e86-505ee78eedfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:37.278605 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a8f9b4e-b2d0-4b02-9e86-505ee78eedfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:37.279059 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a8f9b4e-b2d0-4b02-9e86-505ee78eedfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:37.282944 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a8f9b4e-b2d0-4b02-9e86-505ee78eedfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:37.283502 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a8f9b4e-b2d0-4b02-9e86-505ee78eedfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:37.283949 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a8f9b4e-b2d0-4b02-9e86-505ee78eedfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:37.316054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6d3e2879-6590-46fd-81f1-42d7f1e1e116 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:37.334241 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6d3e2879-6590-46fd-81f1-42d7f1e1e116 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1318 microversion: 2.1 time: 0.612871 Sep 01 17:38:37.334705 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 133/290] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:36 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:37.349601 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d96f143e-6776-4159-97df-cff9676063f9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:37.350466 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d96f143e-6776-4159-97df-cff9676063f9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:37.380716 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d96f143e-6776-4159-97df-cff9676063f9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:37.381477 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d96f143e-6776-4159-97df-cff9676063f9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:37.382137 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d96f143e-6776-4159-97df-cff9676063f9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:37.394015 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d96f143e-6776-4159-97df-cff9676063f9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:37.394774 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d96f143e-6776-4159-97df-cff9676063f9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:37.395384 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d96f143e-6776-4159-97df-cff9676063f9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:37.468289 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-9a8f9b4e-b2d0-4b02-9e86-505ee78eedfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:37.476288 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-9a8f9b4e-b2d0-4b02-9e86-505ee78eedfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1305 microversion: 2.1 time: 0.224695 Sep 01 17:38:37.482562 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 158/291] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:37 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1305 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:37.764128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d96f143e-6776-4159-97df-cff9676063f9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:37.778216 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d96f143e-6776-4159-97df-cff9676063f9 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.442429 Sep 01 17:38:37.779407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 134/292] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:37 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:38.270396 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b77da4ea-4a78-45ec-b3c6-bac3d555331a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:38.271681 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-b77da4ea-4a78-45ec-b3c6-bac3d555331a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:38.290010 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b77da4ea-4a78-45ec-b3c6-bac3d555331a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:38.291928 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b77da4ea-4a78-45ec-b3c6-bac3d555331a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:38.292505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b77da4ea-4a78-45ec-b3c6-bac3d555331a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:38.293405 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b77da4ea-4a78-45ec-b3c6-bac3d555331a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:38.294009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b77da4ea-4a78-45ec-b3c6-bac3d555331a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:38.294958 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b77da4ea-4a78-45ec-b3c6-bac3d555331a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:38.359718 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c9840334-5122-489a-ad34-405f6f78bfc5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:38.360325 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c9840334-5122-489a-ad34-405f6f78bfc5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:38.373009 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c9840334-5122-489a-ad34-405f6f78bfc5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:38.373500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c9840334-5122-489a-ad34-405f6f78bfc5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:38.373965 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c9840334-5122-489a-ad34-405f6f78bfc5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:38.375027 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c9840334-5122-489a-ad34-405f6f78bfc5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:38.375810 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c9840334-5122-489a-ad34-405f6f78bfc5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:38.376079 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c9840334-5122-489a-ad34-405f6f78bfc5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:38.826903 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c9840334-5122-489a-ad34-405f6f78bfc5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:38.831812 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=4 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:38.848189 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c9840334-5122-489a-ad34-405f6f78bfc5 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1318 microversion: 2.1 time: 0.492241 Sep 01 17:38:38.849086 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 135/293] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:38 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:38.853838 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-de28d48d-7a07-45b8-b190-eb3cc1769747 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:38.854671 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-de28d48d-7a07-45b8-b190-eb3cc1769747 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:38.860648 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b77da4ea-4a78-45ec-b3c6-bac3d555331a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:38.877187 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-b77da4ea-4a78-45ec-b3c6-bac3d555331a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1513 microversion: 2.1 time: 0.606744 Sep 01 17:38:38.879685 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-de28d48d-7a07-45b8-b190-eb3cc1769747 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:38.883593 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 159/294] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:38 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1513 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:38.889005 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a6787f2d-cf7c-450e-b5e2-c5f9d46ef596 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:38.890026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-de28d48d-7a07-45b8-b190-eb3cc1769747 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:38.890636 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-de28d48d-7a07-45b8-b190-eb3cc1769747 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:38.891567 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-de28d48d-7a07-45b8-b190-eb3cc1769747 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:38.892186 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-de28d48d-7a07-45b8-b190-eb3cc1769747 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:38.892773 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-de28d48d-7a07-45b8-b190-eb3cc1769747 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:38.902570 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a6787f2d-cf7c-450e-b5e2-c5f9d46ef596 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:38.928303 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a6787f2d-cf7c-450e-b5e2-c5f9d46ef596 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:38.929063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a6787f2d-cf7c-450e-b5e2-c5f9d46ef596 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:38.929598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a6787f2d-cf7c-450e-b5e2-c5f9d46ef596 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:38.939526 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a6787f2d-cf7c-450e-b5e2-c5f9d46ef596 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:38.940019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a6787f2d-cf7c-450e-b5e2-c5f9d46ef596 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:38.940470 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a6787f2d-cf7c-450e-b5e2-c5f9d46ef596 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:39.046069 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-de28d48d-7a07-45b8-b190-eb3cc1769747 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:39.058400 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-de28d48d-7a07-45b8-b190-eb3cc1769747 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1303 microversion: 2.1 time: 0.207990 Sep 01 17:38:39.071059 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 136/295] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:38 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1303 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:39.083299 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-14f4a536-b557-4a9a-8112-796cfb6c5e94 req-e390bce2-5335-4e9c-9e09-fc66c56e4be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46ef555c-0fec-491a-bc16-4e60b61a338d", "tag": "e565bb9b-eb5c-4447-9314-4a49199b5e4e"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:39.101376 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-14f4a536-b557-4a9a-8112-796cfb6c5e94 req-e390bce2-5335-4e9c-9e09-fc66c56e4be7 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:39.102553 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-14f4a536-b557-4a9a-8112-796cfb6c5e94 req-e390bce2-5335-4e9c-9e09-fc66c56e4be7 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:39.102912 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-14f4a536-b557-4a9a-8112-796cfb6c5e94 req-e390bce2-5335-4e9c-9e09-fc66c56e4be7 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:39.116400 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-14f4a536-b557-4a9a-8112-796cfb6c5e94 req-e390bce2-5335-4e9c-9e09-fc66c56e4be7 service nova] Creating event network-changed:e565bb9b-eb5c-4447-9314-4a49199b5e4e for instance 46ef555c-0fec-491a-bc16-4e60b61a338d on hv-cinder-83976 Sep 01 17:38:39.122677 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-14f4a536-b557-4a9a-8112-796cfb6c5e94 req-e390bce2-5335-4e9c-9e09-fc66c56e4be7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050048 Sep 01 17:38:39.123941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 137/296] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:39.237875 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a6787f2d-cf7c-450e-b5e2-c5f9d46ef596 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:39.247908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a6787f2d-cf7c-450e-b5e2-c5f9d46ef596 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.361844 Sep 01 17:38:39.249568 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 160/297] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:38 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:39.903292 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-1e695166-ba60-4943-ba77-7d487d0fd7ba tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:39.903906 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-1e695166-ba60-4943-ba77-7d487d0fd7ba tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:39.926587 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1e695166-ba60-4943-ba77-7d487d0fd7ba tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:39.927349 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1e695166-ba60-4943-ba77-7d487d0fd7ba tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:39.927809 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1e695166-ba60-4943-ba77-7d487d0fd7ba tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:39.928657 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1e695166-ba60-4943-ba77-7d487d0fd7ba tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:39.929117 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1e695166-ba60-4943-ba77-7d487d0fd7ba tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:39.930387 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1e695166-ba60-4943-ba77-7d487d0fd7ba tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:39.948936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ad524786-790b-4f48-ba63-6cd8784ecd58 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:39.949805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ad524786-790b-4f48-ba63-6cd8784ecd58 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:39.972435 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad524786-790b-4f48-ba63-6cd8784ecd58 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:39.975415 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad524786-790b-4f48-ba63-6cd8784ecd58 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:39.976031 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad524786-790b-4f48-ba63-6cd8784ecd58 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:39.978137 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad524786-790b-4f48-ba63-6cd8784ecd58 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:39.980581 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad524786-790b-4f48-ba63-6cd8784ecd58 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:39.981313 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad524786-790b-4f48-ba63-6cd8784ecd58 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:40.780013 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1e695166-ba60-4943-ba77-7d487d0fd7ba tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:40.795306 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ad524786-790b-4f48-ba63-6cd8784ecd58 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:40.817171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ad524786-790b-4f48-ba63-6cd8784ecd58 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1318 microversion: 2.1 time: 0.873340 Sep 01 17:38:40.817787 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 161/298] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:39 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1318 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:40.818877 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-1e695166-ba60-4943-ba77-7d487d0fd7ba tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1513 microversion: 2.1 time: 0.919783 Sep 01 17:38:40.833119 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 138/299] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:39 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1513 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:40.842425 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-d503130b-d7f5-4d2e-9fd1-62bb1446143d req-5eee7bfe-2374-4b64-84c6-9aa2bcdbac21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b3dd05-1820-4e87-a408-322f5c184899", "name": "network-vif-plugged", "status": "completed", "tag": "c5b87571-eded-4c16-9cfa-859bef9322d2"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:40.849272 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-67774739-34cd-4d38-a59f-9de3db43026c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:40.850057 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-67774739-34cd-4d38-a59f-9de3db43026c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:40.874790 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-d503130b-d7f5-4d2e-9fd1-62bb1446143d req-5eee7bfe-2374-4b64-84c6-9aa2bcdbac21 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:40.875685 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-d503130b-d7f5-4d2e-9fd1-62bb1446143d req-5eee7bfe-2374-4b64-84c6-9aa2bcdbac21 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:40.876451 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-d503130b-d7f5-4d2e-9fd1-62bb1446143d req-5eee7bfe-2374-4b64-84c6-9aa2bcdbac21 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:40.898296 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-67774739-34cd-4d38-a59f-9de3db43026c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:40.901405 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-67774739-34cd-4d38-a59f-9de3db43026c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:40.902274 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-67774739-34cd-4d38-a59f-9de3db43026c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:40.904377 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-67774739-34cd-4d38-a59f-9de3db43026c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:40.908029 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-67774739-34cd-4d38-a59f-9de3db43026c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:40.908661 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-67774739-34cd-4d38-a59f-9de3db43026c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:40.962356 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-d503130b-d7f5-4d2e-9fd1-62bb1446143d req-5eee7bfe-2374-4b64-84c6-9aa2bcdbac21 service nova] Creating event network-vif-plugged:c5b87571-eded-4c16-9cfa-859bef9322d2 for instance 22b3dd05-1820-4e87-a408-322f5c184899 on hv-cinder-83976 Sep 01 17:38:40.983537 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-d503130b-d7f5-4d2e-9fd1-62bb1446143d req-5eee7bfe-2374-4b64-84c6-9aa2bcdbac21 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154628 Sep 01 17:38:40.984768 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 139/300] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:40.997810 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-7272fc79-1d02-4599-96aa-f59d08cd0b57 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:41.000000 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-7272fc79-1d02-4599-96aa-f59d08cd0b57 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:41.025087 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7272fc79-1d02-4599-96aa-f59d08cd0b57 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:41.026652 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7272fc79-1d02-4599-96aa-f59d08cd0b57 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:41.027304 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7272fc79-1d02-4599-96aa-f59d08cd0b57 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:41.029935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7272fc79-1d02-4599-96aa-f59d08cd0b57 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:41.031214 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7272fc79-1d02-4599-96aa-f59d08cd0b57 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:41.034174 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7272fc79-1d02-4599-96aa-f59d08cd0b57 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:41.456428 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-67774739-34cd-4d38-a59f-9de3db43026c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:41.467653 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-67774739-34cd-4d38-a59f-9de3db43026c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1371 microversion: 2.1 time: 0.630041 Sep 01 17:38:41.469529 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 162/301] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:40 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1371 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:41.477780 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e364e0e7-05c8-4c01-8fee-aa9df4a1c5d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:41.478430 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e364e0e7-05c8-4c01-8fee-aa9df4a1c5d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:41.486981 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e364e0e7-05c8-4c01-8fee-aa9df4a1c5d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:41.487841 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e364e0e7-05c8-4c01-8fee-aa9df4a1c5d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:41.488908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e364e0e7-05c8-4c01-8fee-aa9df4a1c5d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:41.489792 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e364e0e7-05c8-4c01-8fee-aa9df4a1c5d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:41.490439 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e364e0e7-05c8-4c01-8fee-aa9df4a1c5d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:41.491042 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e364e0e7-05c8-4c01-8fee-aa9df4a1c5d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:41.541706 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7272fc79-1d02-4599-96aa-f59d08cd0b57 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:41.556838 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-7272fc79-1d02-4599-96aa-f59d08cd0b57 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.568629 Sep 01 17:38:41.558135 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 140/302] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:40 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:41.559585 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e364e0e7-05c8-4c01-8fee-aa9df4a1c5d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/ips" status: 200 len: 152 microversion: 2.20 time: 0.086587 Sep 01 17:38:41.561071 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 163/303] 10.222.0.100 () {60 vars in 1294 bytes} [Thu Sep 1 17:38:41 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/ips => generated 152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:38:41.619972 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-ea380242-9f80-4a8a-9a2c-61e2f8d8dae4 req-8b6260eb-da44-49e5-bfff-be626f793e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48752724-82dc-4307-98af-ccc606bf5ca0", "tag": "0989218c-f26f-4809-a710-623c2a8f5c2b"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:41.650349 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-ea380242-9f80-4a8a-9a2c-61e2f8d8dae4 req-8b6260eb-da44-49e5-bfff-be626f793e2e service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:41.651136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-ea380242-9f80-4a8a-9a2c-61e2f8d8dae4 req-8b6260eb-da44-49e5-bfff-be626f793e2e service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:41.651965 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-ea380242-9f80-4a8a-9a2c-61e2f8d8dae4 req-8b6260eb-da44-49e5-bfff-be626f793e2e service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:41.667674 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-ea380242-9f80-4a8a-9a2c-61e2f8d8dae4 req-8b6260eb-da44-49e5-bfff-be626f793e2e service nova] Creating event network-changed:0989218c-f26f-4809-a710-623c2a8f5c2b for instance 48752724-82dc-4307-98af-ccc606bf5ca0 on hv-cinder-83976 Sep 01 17:38:41.674040 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-ea380242-9f80-4a8a-9a2c-61e2f8d8dae4 req-8b6260eb-da44-49e5-bfff-be626f793e2e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104123 Sep 01 17:38:41.674933 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 141/304] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:41.843629 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cafa9373-8b4c-4da7-be09-901da5d869df tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:41.844464 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cafa9373-8b4c-4da7-be09-901da5d869df tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:41.846235 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e09ede63-934a-437e-b2f9-3d7adaa8838f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:41.847152 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e09ede63-934a-437e-b2f9-3d7adaa8838f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:41.855763 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cafa9373-8b4c-4da7-be09-901da5d869df tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:41.858560 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cafa9373-8b4c-4da7-be09-901da5d869df tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:41.859189 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cafa9373-8b4c-4da7-be09-901da5d869df tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:41.860062 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cafa9373-8b4c-4da7-be09-901da5d869df tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:41.862206 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cafa9373-8b4c-4da7-be09-901da5d869df tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:41.864164 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cafa9373-8b4c-4da7-be09-901da5d869df tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:41.864310 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e09ede63-934a-437e-b2f9-3d7adaa8838f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:41.865279 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e09ede63-934a-437e-b2f9-3d7adaa8838f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:41.868512 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e09ede63-934a-437e-b2f9-3d7adaa8838f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:41.869417 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e09ede63-934a-437e-b2f9-3d7adaa8838f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:41.871119 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e09ede63-934a-437e-b2f9-3d7adaa8838f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:41.871875 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e09ede63-934a-437e-b2f9-3d7adaa8838f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:42.303475 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e09ede63-934a-437e-b2f9-3d7adaa8838f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:42.313458 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e09ede63-934a-437e-b2f9-3d7adaa8838f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1519 microversion: 2.1 time: 0.472681 Sep 01 17:38:42.318197 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 142/305] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:41 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1519 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:42.321413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cafa9373-8b4c-4da7-be09-901da5d869df tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:42.332130 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cafa9373-8b4c-4da7-be09-901da5d869df tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1318 microversion: 2.1 time: 0.492245 Sep 01 17:38:42.332967 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 164/306] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:41 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:42.493460 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-48946e50-6841-43f1-8d7a-2d9dc093bac9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:42.495133 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-48946e50-6841-43f1-8d7a-2d9dc093bac9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:42.521803 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-48946e50-6841-43f1-8d7a-2d9dc093bac9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:42.529411 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-48946e50-6841-43f1-8d7a-2d9dc093bac9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:42.531058 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-48946e50-6841-43f1-8d7a-2d9dc093bac9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:42.533044 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-48946e50-6841-43f1-8d7a-2d9dc093bac9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:42.536087 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-48946e50-6841-43f1-8d7a-2d9dc093bac9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:42.536538 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-48946e50-6841-43f1-8d7a-2d9dc093bac9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:42.609746 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=100 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:42.662670 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e26a56e9-d1b1-4d34-8021-6f9842115a5d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:42.663286 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e26a56e9-d1b1-4d34-8021-6f9842115a5d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:42.673045 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e26a56e9-d1b1-4d34-8021-6f9842115a5d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:42.673615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e26a56e9-d1b1-4d34-8021-6f9842115a5d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:42.674761 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e26a56e9-d1b1-4d34-8021-6f9842115a5d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:42.680825 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e26a56e9-d1b1-4d34-8021-6f9842115a5d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:42.684397 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e26a56e9-d1b1-4d34-8021-6f9842115a5d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:42.684839 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e26a56e9-d1b1-4d34-8021-6f9842115a5d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:42.729872 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:43.033505 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-48946e50-6841-43f1-8d7a-2d9dc093bac9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:43.046026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-48946e50-6841-43f1-8d7a-2d9dc093bac9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1371 microversion: 2.1 time: 0.554551 Sep 01 17:38:43.061466 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 143/307] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:42 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1371 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:43.228501 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e26a56e9-d1b1-4d34-8021-6f9842115a5d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:43.254455 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e26a56e9-d1b1-4d34-8021-6f9842115a5d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.608441 Sep 01 17:38:43.258327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 165/308] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:42 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:43.370202 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c25b6f19-7a25-49ed-9cb5-dc37846f0acd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:43.371647 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c25b6f19-7a25-49ed-9cb5-dc37846f0acd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:43.385736 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c25b6f19-7a25-49ed-9cb5-dc37846f0acd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:43.386798 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c25b6f19-7a25-49ed-9cb5-dc37846f0acd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:43.387504 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c25b6f19-7a25-49ed-9cb5-dc37846f0acd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:43.388378 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c25b6f19-7a25-49ed-9cb5-dc37846f0acd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:43.389179 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c25b6f19-7a25-49ed-9cb5-dc37846f0acd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:43.389803 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c25b6f19-7a25-49ed-9cb5-dc37846f0acd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:43.781312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-64498575-1b0d-40c2-b020-e940d2ab93aa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:43.792754 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-64498575-1b0d-40c2-b020-e940d2ab93aa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:43.820875 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c25b6f19-7a25-49ed-9cb5-dc37846f0acd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:43.832288 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c25b6f19-7a25-49ed-9cb5-dc37846f0acd tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1501 microversion: 2.1 time: 0.475344 Sep 01 17:38:43.837165 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 144/309] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:43 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1501 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:43.843373 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-64498575-1b0d-40c2-b020-e940d2ab93aa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:43.846483 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-64498575-1b0d-40c2-b020-e940d2ab93aa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:43.850097 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-64498575-1b0d-40c2-b020-e940d2ab93aa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:43.852078 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-64498575-1b0d-40c2-b020-e940d2ab93aa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:43.856603 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-64498575-1b0d-40c2-b020-e940d2ab93aa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:43.857283 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-64498575-1b0d-40c2-b020-e940d2ab93aa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:43.888726 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-eb87a8f6-4e80-451e-b881-bcfd4cb92641 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Action: 'create', calling method: .version_select at 0x7f354a7cd4c0>, body: {"keypair": {"name": "tempest-keypair-1563200782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4GZ02KaLJbG4Mku8GJgJjWrVODoh2C8vxaNNUJVtwGMFewYaHye3UT34RY1lmT5VozOaYrR9E+V3/eOwppjGMqmG3YJIkOF+0tley0uQehY3E39/RzB9Ouyd9zmrx9vQ=="}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:43.931122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:43.933884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-eb87a8f6-4e80-451e-b881-bcfd4cb92641 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Getting quotas for project b01df46ff9744c2f830459547d7e4dd6. Resources: {'key_pairs'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:38:43.934156 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-64498575-1b0d-40c2-b020-e940d2ab93aa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lazy-loading 'flavor' on Instance uuid 7fc52ad3-09b3-4851-8a50-ad446bd1a75d {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:43.948074 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-eb87a8f6-4e80-451e-b881-bcfd4cb92641 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Getting quotas for user 5647214c5b3f438eb3ef1ddc14153d9e and project b01df46ff9744c2f830459547d7e4dd6. Resources: {'key_pairs'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:38:44.019137 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-eb87a8f6-4e80-451e-b881-bcfd4cb92641 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140489 Sep 01 17:38:44.031699 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 145/310] 10.222.0.100 () {60 vars in 1164 bytes} [Thu Sep 1 17:38:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:44.072481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-095052f3-5c51-49bc-8a24-eee2cf42cf95 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:44.073091 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-095052f3-5c51-49bc-8a24-eee2cf42cf95 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:44.084342 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-095052f3-5c51-49bc-8a24-eee2cf42cf95 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:44.084841 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-095052f3-5c51-49bc-8a24-eee2cf42cf95 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:44.086905 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-095052f3-5c51-49bc-8a24-eee2cf42cf95 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:44.089905 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-095052f3-5c51-49bc-8a24-eee2cf42cf95 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:44.092418 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-095052f3-5c51-49bc-8a24-eee2cf42cf95 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:44.093032 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-095052f3-5c51-49bc-8a24-eee2cf42cf95 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:44.253370 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=16 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:44.368575 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-095052f3-5c51-49bc-8a24-eee2cf42cf95 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:44.382095 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-095052f3-5c51-49bc-8a24-eee2cf42cf95 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1371 microversion: 2.1 time: 0.316078 Sep 01 17:38:44.383976 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 146/311] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:44 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1371 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:44.389157 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e71264db-ed93-4750-8152-df5b50e5293a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:44.390541 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e71264db-ed93-4750-8152-df5b50e5293a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:44.397500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e71264db-ed93-4750-8152-df5b50e5293a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:44.398983 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e71264db-ed93-4750-8152-df5b50e5293a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:44.399596 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e71264db-ed93-4750-8152-df5b50e5293a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:44.401000 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e71264db-ed93-4750-8152-df5b50e5293a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:44.401836 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e71264db-ed93-4750-8152-df5b50e5293a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:44.403243 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e71264db-ed93-4750-8152-df5b50e5293a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:44.479955 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-64498575-1b0d-40c2-b020-e940d2ab93aa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "POST /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/action" status: 202 len: 0 microversion: 2.20 time: 0.707974 Sep 01 17:38:44.483388 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 166/312] 10.222.0.100 () {62 vars in 1324 bytes} [Thu Sep 1 17:38:43 2022] POST /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 17:38:44.502157 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e1d2fd91-e4ea-42a8-a114-90dc1dd03fa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:44.504495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e1d2fd91-e4ea-42a8-a114-90dc1dd03fa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:44.528180 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e1d2fd91-e4ea-42a8-a114-90dc1dd03fa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:44.529919 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e1d2fd91-e4ea-42a8-a114-90dc1dd03fa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:44.531841 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e1d2fd91-e4ea-42a8-a114-90dc1dd03fa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:44.534167 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e1d2fd91-e4ea-42a8-a114-90dc1dd03fa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:44.535745 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e1d2fd91-e4ea-42a8-a114-90dc1dd03fa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:44.536448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e1d2fd91-e4ea-42a8-a114-90dc1dd03fa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:44.740732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e71264db-ed93-4750-8152-df5b50e5293a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:44.760978 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e71264db-ed93-4750-8152-df5b50e5293a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.373859 Sep 01 17:38:44.762584 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 147/313] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:44 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:44.778019 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-650678de-4f73-4d3f-99a3-79c3518e2d5a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:44.778756 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-650678de-4f73-4d3f-99a3-79c3518e2d5a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:44.795303 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-650678de-4f73-4d3f-99a3-79c3518e2d5a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:44.796881 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-650678de-4f73-4d3f-99a3-79c3518e2d5a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:44.798225 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-650678de-4f73-4d3f-99a3-79c3518e2d5a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:44.800637 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-650678de-4f73-4d3f-99a3-79c3518e2d5a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:44.802535 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-650678de-4f73-4d3f-99a3-79c3518e2d5a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:44.803176 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-650678de-4f73-4d3f-99a3-79c3518e2d5a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:44.849936 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-650678de-4f73-4d3f-99a3-79c3518e2d5a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Going to try to terminate instance {{(pid=127232) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:38:44.906988 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e1d2fd91-e4ea-42a8-a114-90dc1dd03fa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:44.921696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e1d2fd91-e4ea-42a8-a114-90dc1dd03fa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:44.925036 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e1d2fd91-e4ea-42a8-a114-90dc1dd03fa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:44.928917 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e1d2fd91-e4ea-42a8-a114-90dc1dd03fa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.436472 Sep 01 17:38:44.930850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 167/314] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:44 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:45.030708 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-650678de-4f73-4d3f-99a3-79c3518e2d5a tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "DELETE /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 204 len: 0 microversion: 2.1 time: 0.266014 Sep 01 17:38:45.031751 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 148/315] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:38:44 2022] DELETE /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:38:45.063594 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cc807a97-b1fa-49fc-815e-e933bb44d346 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:45.064278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cc807a97-b1fa-49fc-815e-e933bb44d346 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:45.073280 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cc807a97-b1fa-49fc-815e-e933bb44d346 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:45.073864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cc807a97-b1fa-49fc-815e-e933bb44d346 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:45.074296 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cc807a97-b1fa-49fc-815e-e933bb44d346 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:45.075251 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cc807a97-b1fa-49fc-815e-e933bb44d346 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:45.075866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cc807a97-b1fa-49fc-815e-e933bb44d346 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:45.076450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cc807a97-b1fa-49fc-815e-e933bb44d346 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:45.350816 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cc807a97-b1fa-49fc-815e-e933bb44d346 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:45.363027 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cc807a97-b1fa-49fc-815e-e933bb44d346 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1507 microversion: 2.1 time: 0.324664 Sep 01 17:38:45.379084 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 168/316] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:45 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:45.408160 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f3c07594-b047-4ced-b581-99465c616d20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:45.409497 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f3c07594-b047-4ced-b581-99465c616d20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:45.419440 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f3c07594-b047-4ced-b581-99465c616d20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:45.420403 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f3c07594-b047-4ced-b581-99465c616d20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:45.421953 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f3c07594-b047-4ced-b581-99465c616d20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:45.423252 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f3c07594-b047-4ced-b581-99465c616d20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:45.424211 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f3c07594-b047-4ced-b581-99465c616d20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:45.425010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f3c07594-b047-4ced-b581-99465c616d20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:45.790397 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2bac41c9-760e-4e41-a31c-dff14c3ee0f6 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:45.791333 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2bac41c9-760e-4e41-a31c-dff14c3ee0f6 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:45.828960 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2bac41c9-760e-4e41-a31c-dff14c3ee0f6 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:45.839390 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2bac41c9-760e-4e41-a31c-dff14c3ee0f6 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:45.840120 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2bac41c9-760e-4e41-a31c-dff14c3ee0f6 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:45.840907 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2bac41c9-760e-4e41-a31c-dff14c3ee0f6 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:45.841465 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2bac41c9-760e-4e41-a31c-dff14c3ee0f6 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:45.872826 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2bac41c9-760e-4e41-a31c-dff14c3ee0f6 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:46.062789 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f3c07594-b047-4ced-b581-99465c616d20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:46.078327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f3c07594-b047-4ced-b581-99465c616d20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1371 microversion: 2.1 time: 0.675515 Sep 01 17:38:46.079201 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 149/317] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:45 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1371 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:46.089529 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a57e43d8-e629-4108-989f-a84d7ce77823 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:46.090182 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a57e43d8-e629-4108-989f-a84d7ce77823 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:46.123420 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a57e43d8-e629-4108-989f-a84d7ce77823 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:46.124085 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a57e43d8-e629-4108-989f-a84d7ce77823 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:46.124528 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a57e43d8-e629-4108-989f-a84d7ce77823 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:46.125364 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a57e43d8-e629-4108-989f-a84d7ce77823 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:46.125784 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a57e43d8-e629-4108-989f-a84d7ce77823 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:46.126231 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a57e43d8-e629-4108-989f-a84d7ce77823 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:46.540560 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2bac41c9-760e-4e41-a31c-dff14c3ee0f6 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:46.555464 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a57e43d8-e629-4108-989f-a84d7ce77823 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:46.558826 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2bac41c9-760e-4e41-a31c-dff14c3ee0f6 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.773907 Sep 01 17:38:46.560037 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 169/318] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:45 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:46.565082 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4a34c0e3-512e-4a6f-9015-34e32f37bfc9 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:46.565942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4a34c0e3-512e-4a6f-9015-34e32f37bfc9 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:46.572890 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a57e43d8-e629-4108-989f-a84d7ce77823 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:46.574402 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a57e43d8-e629-4108-989f-a84d7ce77823 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:46.576061 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a57e43d8-e629-4108-989f-a84d7ce77823 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.495756 Sep 01 17:38:46.577948 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a34c0e3-512e-4a6f-9015-34e32f37bfc9 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:46.579189 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a34c0e3-512e-4a6f-9015-34e32f37bfc9 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:46.580903 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a34c0e3-512e-4a6f-9015-34e32f37bfc9 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:46.583537 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a34c0e3-512e-4a6f-9015-34e32f37bfc9 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:46.584207 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a34c0e3-512e-4a6f-9015-34e32f37bfc9 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:46.584957 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a34c0e3-512e-4a6f-9015-34e32f37bfc9 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:46.590154 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 150/319] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:46 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:47.100545 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e691244d-fc35-4f63-bde9-7881adf18000 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:47.101533 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e691244d-fc35-4f63-bde9-7881adf18000 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:47.109613 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e691244d-fc35-4f63-bde9-7881adf18000 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:47.110753 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e691244d-fc35-4f63-bde9-7881adf18000 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:47.110919 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e691244d-fc35-4f63-bde9-7881adf18000 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:47.111815 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e691244d-fc35-4f63-bde9-7881adf18000 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:47.113135 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e691244d-fc35-4f63-bde9-7881adf18000 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:47.113781 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e691244d-fc35-4f63-bde9-7881adf18000 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:47.270267 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4a34c0e3-512e-4a6f-9015-34e32f37bfc9 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:47.290308 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4a34c0e3-512e-4a6f-9015-34e32f37bfc9 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1507 microversion: 2.1 time: 0.728423 Sep 01 17:38:47.323949 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 170/320] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:46 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1507 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:47.606699 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8c04fdb5-d7b6-4bcd-9ba9-a18239f10398 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:47.609670 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8c04fdb5-d7b6-4bcd-9ba9-a18239f10398 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:47.620616 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c04fdb5-d7b6-4bcd-9ba9-a18239f10398 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:47.621430 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c04fdb5-d7b6-4bcd-9ba9-a18239f10398 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:47.622161 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c04fdb5-d7b6-4bcd-9ba9-a18239f10398 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:47.623928 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c04fdb5-d7b6-4bcd-9ba9-a18239f10398 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:47.624630 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c04fdb5-d7b6-4bcd-9ba9-a18239f10398 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:47.625498 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8c04fdb5-d7b6-4bcd-9ba9-a18239f10398 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:47.793859 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e691244d-fc35-4f63-bde9-7881adf18000 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:47.803842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e691244d-fc35-4f63-bde9-7881adf18000 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1371 microversion: 2.1 time: 0.707194 Sep 01 17:38:47.814502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 151/321] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:47 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1371 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:47.820114 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-258d7c89-cf3e-4de3-9826-1500b15f2896 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:47.821023 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-258d7c89-cf3e-4de3-9826-1500b15f2896 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:47.838824 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-258d7c89-cf3e-4de3-9826-1500b15f2896 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:47.839332 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-258d7c89-cf3e-4de3-9826-1500b15f2896 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:47.839753 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-258d7c89-cf3e-4de3-9826-1500b15f2896 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:47.840473 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-258d7c89-cf3e-4de3-9826-1500b15f2896 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:47.840920 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-258d7c89-cf3e-4de3-9826-1500b15f2896 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:47.841392 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-258d7c89-cf3e-4de3-9826-1500b15f2896 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:48.126372 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8c04fdb5-d7b6-4bcd-9ba9-a18239f10398 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:48.140851 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8c04fdb5-d7b6-4bcd-9ba9-a18239f10398 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.543007 Sep 01 17:38:48.146113 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 171/322] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:47 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:48.291236 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-258d7c89-cf3e-4de3-9826-1500b15f2896 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:48.311980 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-258d7c89-cf3e-4de3-9826-1500b15f2896 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:48.315681 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-258d7c89-cf3e-4de3-9826-1500b15f2896 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:48.317724 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-258d7c89-cf3e-4de3-9826-1500b15f2896 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.501289 Sep 01 17:38:48.317851 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0b7ac27a-53d3-457c-8f6f-89b624698b01 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:48.318397 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0b7ac27a-53d3-457c-8f6f-89b624698b01 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:48.321415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 152/323] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:47 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:48.340817 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0b7ac27a-53d3-457c-8f6f-89b624698b01 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:48.341594 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0b7ac27a-53d3-457c-8f6f-89b624698b01 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:48.342476 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0b7ac27a-53d3-457c-8f6f-89b624698b01 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:48.343422 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0b7ac27a-53d3-457c-8f6f-89b624698b01 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:48.344080 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0b7ac27a-53d3-457c-8f6f-89b624698b01 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:48.344703 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0b7ac27a-53d3-457c-8f6f-89b624698b01 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:48.606103 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-04d605b9-59de-4d79-a021-900faff5fddc req-788e0540-5231-4d15-920a-1564b3350535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48752724-82dc-4307-98af-ccc606bf5ca0", "name": "network-vif-plugged", "status": "completed", "tag": "0989218c-f26f-4809-a710-623c2a8f5c2b"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:48.638062 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-04d605b9-59de-4d79-a021-900faff5fddc req-788e0540-5231-4d15-920a-1564b3350535 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:48.638646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-04d605b9-59de-4d79-a021-900faff5fddc req-788e0540-5231-4d15-920a-1564b3350535 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:48.639097 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-04d605b9-59de-4d79-a021-900faff5fddc req-788e0540-5231-4d15-920a-1564b3350535 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:48.659927 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-04d605b9-59de-4d79-a021-900faff5fddc req-788e0540-5231-4d15-920a-1564b3350535 service nova] Creating event network-vif-plugged:0989218c-f26f-4809-a710-623c2a8f5c2b for instance 48752724-82dc-4307-98af-ccc606bf5ca0 on hv-cinder-83976 Sep 01 17:38:48.674016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-04d605b9-59de-4d79-a021-900faff5fddc req-788e0540-5231-4d15-920a-1564b3350535 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071740 Sep 01 17:38:48.675848 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 153/324] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:38:48.827571 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bbddb9fa-9cd1-4b77-95d4-e9a669a5d67f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:48.828398 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bbddb9fa-9cd1-4b77-95d4-e9a669a5d67f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:48.836920 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbddb9fa-9cd1-4b77-95d4-e9a669a5d67f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:48.838003 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbddb9fa-9cd1-4b77-95d4-e9a669a5d67f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:48.838544 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbddb9fa-9cd1-4b77-95d4-e9a669a5d67f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:48.840289 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbddb9fa-9cd1-4b77-95d4-e9a669a5d67f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:48.841187 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbddb9fa-9cd1-4b77-95d4-e9a669a5d67f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:48.841750 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbddb9fa-9cd1-4b77-95d4-e9a669a5d67f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:48.883000 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0b7ac27a-53d3-457c-8f6f-89b624698b01 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:48.897936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0b7ac27a-53d3-457c-8f6f-89b624698b01 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1507 microversion: 2.1 time: 0.583465 Sep 01 17:38:48.901851 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 172/325] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:48 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1507 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:49.018678 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-f30cef95-79ac-4ea4-ab0b-afccb61880c6 req-10cb7e38-a589-4d59-8cf8-81c48a614af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b3dd05-1820-4e87-a408-322f5c184899", "name": "network-vif-deleted", "tag": "c5b87571-eded-4c16-9cfa-859bef9322d2"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:49.039528 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-f30cef95-79ac-4ea4-ab0b-afccb61880c6 req-10cb7e38-a589-4d59-8cf8-81c48a614af0 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:49.040113 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-f30cef95-79ac-4ea4-ab0b-afccb61880c6 req-10cb7e38-a589-4d59-8cf8-81c48a614af0 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:49.043761 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-f30cef95-79ac-4ea4-ab0b-afccb61880c6 req-10cb7e38-a589-4d59-8cf8-81c48a614af0 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:49.063526 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-f30cef95-79ac-4ea4-ab0b-afccb61880c6 req-10cb7e38-a589-4d59-8cf8-81c48a614af0 service nova] Creating event network-vif-deleted:c5b87571-eded-4c16-9cfa-859bef9322d2 for instance 22b3dd05-1820-4e87-a408-322f5c184899 on hv-cinder-83976 Sep 01 17:38:49.074809 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-f30cef95-79ac-4ea4-ab0b-afccb61880c6 req-10cb7e38-a589-4d59-8cf8-81c48a614af0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060703 Sep 01 17:38:49.075719 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 173/326] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:49.152767 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bbddb9fa-9cd1-4b77-95d4-e9a669a5d67f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:49.164736 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bbddb9fa-9cd1-4b77-95d4-e9a669a5d67f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1371 microversion: 2.1 time: 0.342406 Sep 01 17:38:49.166067 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4799ac08-4992-45a1-81b9-ec12658d226b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:49.166774 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4799ac08-4992-45a1-81b9-ec12658d226b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:49.177773 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4799ac08-4992-45a1-81b9-ec12658d226b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:49.182053 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 154/327] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:48 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1371 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:49.183470 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4799ac08-4992-45a1-81b9-ec12658d226b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:49.184091 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4799ac08-4992-45a1-81b9-ec12658d226b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:49.184985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4799ac08-4992-45a1-81b9-ec12658d226b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:49.185622 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4799ac08-4992-45a1-81b9-ec12658d226b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:49.186197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4799ac08-4992-45a1-81b9-ec12658d226b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:49.345083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-fb493d27-9328-4c6d-a7ce-361f1a7c5304 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:49.345821 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-fb493d27-9328-4c6d-a7ce-361f1a7c5304 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:49.357755 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb493d27-9328-4c6d-a7ce-361f1a7c5304 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:49.358949 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb493d27-9328-4c6d-a7ce-361f1a7c5304 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:49.360194 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb493d27-9328-4c6d-a7ce-361f1a7c5304 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:49.361457 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb493d27-9328-4c6d-a7ce-361f1a7c5304 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:49.366122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb493d27-9328-4c6d-a7ce-361f1a7c5304 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:49.366651 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb493d27-9328-4c6d-a7ce-361f1a7c5304 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:49.611294 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4799ac08-4992-45a1-81b9-ec12658d226b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:49.622092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4799ac08-4992-45a1-81b9-ec12658d226b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.460867 Sep 01 17:38:49.623332 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 174/328] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:49 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:49.666694 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-fb493d27-9328-4c6d-a7ce-361f1a7c5304 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:49.677339 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-fb493d27-9328-4c6d-a7ce-361f1a7c5304 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:49.678811 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-fb493d27-9328-4c6d-a7ce-361f1a7c5304 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:49.680717 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-fb493d27-9328-4c6d-a7ce-361f1a7c5304 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.340121 Sep 01 17:38:49.681882 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 155/329] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:49 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:38:49.764869 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1493459927", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e76aae4-b875-498c-b34d-2c5cc4479842"}], "security_groups": [{"name": "tempest-securitygroup--1664014242"}], "key_name": "tempest-keypair-1563200782", "user_data": "}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:49.866267 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e14ae73d-e29f-4461-bfeb-9fc4b249d9c6 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Action: 'create', calling method: .version_select at 0x7f354a6cba60>, body: {"keypair": {"name": "tempest-TestShelveInstance-41354798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTE82+GO2MpB709lpm4exzKkRwM6VZgM4kcrJfNAlHM5h2vwd3IpPjpJXxbLW2pFL//0yIIK6zu2mBLDKcPdZqcmfD6kA+RLIv+7knoO9YSpRzrkR3DsYKKYHqtwshknA=="}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:49.880264 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.network.neutron [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] validate_networks() for [('8e76aae4-b875-498c-b34d-2c5cc4479842', None, None, None, None, None)] {{(pid=127232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:38:49.895216 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-e14ae73d-e29f-4461-bfeb-9fc4b249d9c6 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Getting quotas for project b3f3bf24fbbd42919ad87cc04e4f6042. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:38:49.899991 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-e14ae73d-e29f-4461-bfeb-9fc4b249d9c6 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Getting quotas for user 289058107592455fbf5af315fba7a126 and project b3f3bf24fbbd42919ad87cc04e4f6042. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:38:49.931893 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e14ae73d-e29f-4461-bfeb-9fc4b249d9c6 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.282093 Sep 01 17:38:49.933691 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 175/330] 10.222.0.100 () {60 vars in 1164 bytes} [Thu Sep 1 17:38:49 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:49.942359 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-08325027-356b-42c0-8217-b5d9a3a1b174 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:49.943353 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-08325027-356b-42c0-8217-b5d9a3a1b174 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:49.951782 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08325027-356b-42c0-8217-b5d9a3a1b174 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:49.952524 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08325027-356b-42c0-8217-b5d9a3a1b174 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:49.953846 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08325027-356b-42c0-8217-b5d9a3a1b174 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:49.954830 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08325027-356b-42c0-8217-b5d9a3a1b174 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:49.955451 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08325027-356b-42c0-8217-b5d9a3a1b174 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:49.956025 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08325027-356b-42c0-8217-b5d9a3a1b174 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:50.051692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-08325027-356b-42c0-8217-b5d9a3a1b174 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:50.062603 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-08325027-356b-42c0-8217-b5d9a3a1b174 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1465 microversion: 2.1 time: 0.127331 Sep 01 17:38:50.063195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 176/331] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:49 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1465 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:50.192211 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-136afbf2-975c-4baa-95ca-d30cc0a4f950 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:50.192820 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-136afbf2-975c-4baa-95ca-d30cc0a4f950 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:50.199897 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-136afbf2-975c-4baa-95ca-d30cc0a4f950 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:50.200687 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-136afbf2-975c-4baa-95ca-d30cc0a4f950 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:50.201122 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-136afbf2-975c-4baa-95ca-d30cc0a4f950 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:50.201866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-136afbf2-975c-4baa-95ca-d30cc0a4f950 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:50.202310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-136afbf2-975c-4baa-95ca-d30cc0a4f950 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:50.202885 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-136afbf2-975c-4baa-95ca-d30cc0a4f950 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:50.965533 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-136afbf2-975c-4baa-95ca-d30cc0a4f950 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:50.975808 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-136afbf2-975c-4baa-95ca-d30cc0a4f950 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1371 microversion: 2.1 time: 0.787355 Sep 01 17:38:50.980230 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 177/332] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:50 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1371 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:51.006239 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-aff20e24-9015-4aee-8d05-0d583859ad8a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:51.009936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-aff20e24-9015-4aee-8d05-0d583859ad8a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:51.016587 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-aff20e24-9015-4aee-8d05-0d583859ad8a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:51.017074 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-aff20e24-9015-4aee-8d05-0d583859ad8a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:51.017504 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-aff20e24-9015-4aee-8d05-0d583859ad8a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:51.018458 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-aff20e24-9015-4aee-8d05-0d583859ad8a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:51.018906 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-aff20e24-9015-4aee-8d05-0d583859ad8a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:51.019330 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-aff20e24-9015-4aee-8d05-0d583859ad8a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:51.255474 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Flavor limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:38:51.255946 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Image limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:38:51.256852 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Flavor pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:38:51.257371 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Image pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:38:51.258672 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:38:51.272789 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=17 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:51.276107 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:51.276768 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:51.277891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:51.278934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:51.279599 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:51.280471 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:51.302004 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Getting quotas for project b01df46ff9744c2f830459547d7e4dd6. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:38:51.309337 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Getting quotas for user 5647214c5b3f438eb3ef1ddc14153d9e and project b01df46ff9744c2f830459547d7e4dd6. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:38:51.324214 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Going to run 1 instances... {{(pid=127232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:38:51.326847 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:38:51.393927 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-345e9882-e651-4517-8947-e1c08338f37d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 1.634302 Sep 01 17:38:51.394944 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 156/333] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:38:49 2022] POST /compute/v2.1/servers => generated 411 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 01 17:38:51.400447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-01e3b115-632c-45bb-9a13-cba7610a40b1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:51.401358 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-01e3b115-632c-45bb-9a13-cba7610a40b1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:51.409000 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-aff20e24-9015-4aee-8d05-0d583859ad8a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:51.409378 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-01e3b115-632c-45bb-9a13-cba7610a40b1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:51.410084 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-01e3b115-632c-45bb-9a13-cba7610a40b1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:51.410703 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-01e3b115-632c-45bb-9a13-cba7610a40b1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:51.412647 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-01e3b115-632c-45bb-9a13-cba7610a40b1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:51.413751 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-01e3b115-632c-45bb-9a13-cba7610a40b1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:51.415046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-01e3b115-632c-45bb-9a13-cba7610a40b1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:51.422221 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-aff20e24-9015-4aee-8d05-0d583859ad8a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.423091 Sep 01 17:38:51.423373 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 178/334] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:50 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:51.434874 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:51.434874 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:51.445954 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:51.446818 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:51.447484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:51.448559 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:51.449235 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:51.450099 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:51.498076 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:51.498664 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:51.499167 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:51.500119 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lazy-loading 'fault' on Instance uuid 22b3dd05-1820-4e87-a408-322f5c184899 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:51.602465 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:51.611738 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7d6a063e-d804-4576-aa45-3cd5b804882c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1308 microversion: 2.1 time: 0.186946 Sep 01 17:38:51.612741 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 179/335] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:51 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:51.631836 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f81ae1fb-6ba3-46b6-87fe-22c00ad41352 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:51.633849 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f81ae1fb-6ba3-46b6-87fe-22c00ad41352 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:51.642681 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:51.723350 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f81ae1fb-6ba3-46b6-87fe-22c00ad41352 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:51.726951 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-01e3b115-632c-45bb-9a13-cba7610a40b1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:51.732007 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f81ae1fb-6ba3-46b6-87fe-22c00ad41352 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1250 microversion: 2.1 time: 0.118024 Sep 01 17:38:51.732840 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 180/336] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:51 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1250 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:51.736757 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-01e3b115-632c-45bb-9a13-cba7610a40b1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:51.738263 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-01e3b115-632c-45bb-9a13-cba7610a40b1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:51.739455 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-01e3b115-632c-45bb-9a13-cba7610a40b1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.343479 Sep 01 17:38:51.740034 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 157/337] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:51 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:52.002724 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-bce8c4e0-5220-4ef9-8526-50edfd8fb54d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:52.003423 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-bce8c4e0-5220-4ef9-8526-50edfd8fb54d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:52.012192 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bce8c4e0-5220-4ef9-8526-50edfd8fb54d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:52.012683 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bce8c4e0-5220-4ef9-8526-50edfd8fb54d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:52.013151 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bce8c4e0-5220-4ef9-8526-50edfd8fb54d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:52.013927 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bce8c4e0-5220-4ef9-8526-50edfd8fb54d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:52.014278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bce8c4e0-5220-4ef9-8526-50edfd8fb54d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:52.014712 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bce8c4e0-5220-4ef9-8526-50edfd8fb54d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:52.175859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-bce8c4e0-5220-4ef9-8526-50edfd8fb54d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:52.191466 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-bce8c4e0-5220-4ef9-8526-50edfd8fb54d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1371 microversion: 2.1 time: 0.193756 Sep 01 17:38:52.196719 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 181/338] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:51 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:52.447010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b2839372-31af-41e6-8f1a-bde8a0630cee tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:52.447563 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b2839372-31af-41e6-8f1a-bde8a0630cee tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:52.453725 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b2839372-31af-41e6-8f1a-bde8a0630cee tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:52.454469 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b2839372-31af-41e6-8f1a-bde8a0630cee tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:52.455289 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b2839372-31af-41e6-8f1a-bde8a0630cee tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:52.456372 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b2839372-31af-41e6-8f1a-bde8a0630cee tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:52.457059 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b2839372-31af-41e6-8f1a-bde8a0630cee tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:52.457738 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b2839372-31af-41e6-8f1a-bde8a0630cee tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:52.635048 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:52.635458 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b2839372-31af-41e6-8f1a-bde8a0630cee tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:52.635660 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:52.644175 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:52.644672 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:52.645107 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:52.645843 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:52.646013 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b2839372-31af-41e6-8f1a-bde8a0630cee tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.203402 Sep 01 17:38:52.646302 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:52.646720 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:52.646845 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 158/339] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:52 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:52.668548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:52.689453 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:52.689985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:52.690418 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:52.690867 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lazy-loading 'fault' on Instance uuid 22b3dd05-1820-4e87-a408-322f5c184899 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:52.735110 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:52.743986 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-18b9f7f0-07a0-4cf4-913d-8f542264309c tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1308 microversion: 2.1 time: 0.113048 Sep 01 17:38:52.744575 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 182/340] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:52 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:52.765754 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7432ec60-dc21-46a3-a4ed-20101a8eb539 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:52.766675 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7432ec60-dc21-46a3-a4ed-20101a8eb539 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:52.768047 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2f930add-f9a9-4cd8-97e9-f2eb6b8f1f68 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:52.769189 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2f930add-f9a9-4cd8-97e9-f2eb6b8f1f68 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:52.774765 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7432ec60-dc21-46a3-a4ed-20101a8eb539 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:52.775263 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7432ec60-dc21-46a3-a4ed-20101a8eb539 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:52.775693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7432ec60-dc21-46a3-a4ed-20101a8eb539 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:52.776404 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7432ec60-dc21-46a3-a4ed-20101a8eb539 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:52.776855 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7432ec60-dc21-46a3-a4ed-20101a8eb539 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:52.777455 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7432ec60-dc21-46a3-a4ed-20101a8eb539 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:52.781232 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2f930add-f9a9-4cd8-97e9-f2eb6b8f1f68 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:52.783085 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2f930add-f9a9-4cd8-97e9-f2eb6b8f1f68 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:52.783886 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2f930add-f9a9-4cd8-97e9-f2eb6b8f1f68 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:52.785175 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2f930add-f9a9-4cd8-97e9-f2eb6b8f1f68 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:52.785831 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2f930add-f9a9-4cd8-97e9-f2eb6b8f1f68 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:52.786265 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2f930add-f9a9-4cd8-97e9-f2eb6b8f1f68 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:52.874122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2f930add-f9a9-4cd8-97e9-f2eb6b8f1f68 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:52.881946 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2f930add-f9a9-4cd8-97e9-f2eb6b8f1f68 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1254 microversion: 2.1 time: 0.121590 Sep 01 17:38:52.882915 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 159/341] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:52 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1254 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:52.943524 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7432ec60-dc21-46a3-a4ed-20101a8eb539 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:52.952330 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7432ec60-dc21-46a3-a4ed-20101a8eb539 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:52.953810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7432ec60-dc21-46a3-a4ed-20101a8eb539 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:52.954952 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7432ec60-dc21-46a3-a4ed-20101a8eb539 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.193825 Sep 01 17:38:52.955507 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 183/342] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:52 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:38:53.216850 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4301e8a2-e2d2-4cdf-a02c-08731db2a071 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:53.217461 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4301e8a2-e2d2-4cdf-a02c-08731db2a071 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:53.220504 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:53.225963 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4301e8a2-e2d2-4cdf-a02c-08731db2a071 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.227202 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4301e8a2-e2d2-4cdf-a02c-08731db2a071 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.227519 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4301e8a2-e2d2-4cdf-a02c-08731db2a071 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.228216 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4301e8a2-e2d2-4cdf-a02c-08731db2a071 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.228668 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4301e8a2-e2d2-4cdf-a02c-08731db2a071 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.229349 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4301e8a2-e2d2-4cdf-a02c-08731db2a071 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.376877 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4301e8a2-e2d2-4cdf-a02c-08731db2a071 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:53.380361 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:53.386285 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4301e8a2-e2d2-4cdf-a02c-08731db2a071 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1371 microversion: 2.1 time: 0.173239 Sep 01 17:38:53.387017 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 160/343] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:53 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:53.668953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8068e283-b0a2-4450-b5dd-7910e8ffd748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:53.669686 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8068e283-b0a2-4450-b5dd-7910e8ffd748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:53.676173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8068e283-b0a2-4450-b5dd-7910e8ffd748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.676653 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8068e283-b0a2-4450-b5dd-7910e8ffd748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.677149 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8068e283-b0a2-4450-b5dd-7910e8ffd748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.677817 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8068e283-b0a2-4450-b5dd-7910e8ffd748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.678265 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8068e283-b0a2-4450-b5dd-7910e8ffd748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.678690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8068e283-b0a2-4450-b5dd-7910e8ffd748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.775647 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:53.776554 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:53.784154 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.784656 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.785275 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.786633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.787524 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.788142 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.828069 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.828831 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.829270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.829907 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lazy-loading 'fault' on Instance uuid 22b3dd05-1820-4e87-a408-322f5c184899 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:53.844965 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8068e283-b0a2-4450-b5dd-7910e8ffd748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:53.857038 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8068e283-b0a2-4450-b5dd-7910e8ffd748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.191916 Sep 01 17:38:53.858055 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 184/344] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:53 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:53.879304 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75de510214004bbeab187d65bf178735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d731e34b24c9d8852516ae9141124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:53.889188 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-56691bc1-57de-42f0-8f8a-89f3e6d66a70 tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 200 len: 1308 microversion: 2.1 time: 0.118951 Sep 01 17:38:53.890322 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 161/345] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:53 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:53.908776 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6adee8ca-0263-4063-b2b7-c3bebc3e88df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:53.910362 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6adee8ca-0263-4063-b2b7-c3bebc3e88df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:53.918170 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6adee8ca-0263-4063-b2b7-c3bebc3e88df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.918663 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6adee8ca-0263-4063-b2b7-c3bebc3e88df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.919097 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6adee8ca-0263-4063-b2b7-c3bebc3e88df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.919807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6adee8ca-0263-4063-b2b7-c3bebc3e88df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.920894 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6adee8ca-0263-4063-b2b7-c3bebc3e88df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.920894 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6adee8ca-0263-4063-b2b7-c3bebc3e88df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.977533 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-53403936-fd94-456b-8951-a6a41ec33fb7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:53.978791 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-53403936-fd94-456b-8951-a6a41ec33fb7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:53.985822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53403936-fd94-456b-8951-a6a41ec33fb7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.986310 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53403936-fd94-456b-8951-a6a41ec33fb7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.986741 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53403936-fd94-456b-8951-a6a41ec33fb7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.987432 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53403936-fd94-456b-8951-a6a41ec33fb7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.987877 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53403936-fd94-456b-8951-a6a41ec33fb7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.988289 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53403936-fd94-456b-8951-a6a41ec33fb7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.997235 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-6adee8ca-0263-4063-b2b7-c3bebc3e88df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:54.005156 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-6adee8ca-0263-4063-b2b7-c3bebc3e88df tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1254 microversion: 2.1 time: 0.105187 Sep 01 17:38:54.005838 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 185/346] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:53 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1254 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:54.145270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-53403936-fd94-456b-8951-a6a41ec33fb7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:54.156617 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-53403936-fd94-456b-8951-a6a41ec33fb7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:54.158546 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-53403936-fd94-456b-8951-a6a41ec33fb7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:54.159735 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-53403936-fd94-456b-8951-a6a41ec33fb7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.186752 Sep 01 17:38:54.160899 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 162/347] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:53 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:38:54.407717 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-be7821ae-477b-4612-ad46-e98fdafade9f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:54.408332 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-be7821ae-477b-4612-ad46-e98fdafade9f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:54.415133 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-be7821ae-477b-4612-ad46-e98fdafade9f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:54.415633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-be7821ae-477b-4612-ad46-e98fdafade9f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:54.416068 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-be7821ae-477b-4612-ad46-e98fdafade9f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:54.416769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-be7821ae-477b-4612-ad46-e98fdafade9f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:54.417226 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-be7821ae-477b-4612-ad46-e98fdafade9f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:54.417676 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-be7821ae-477b-4612-ad46-e98fdafade9f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:54.575387 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-be7821ae-477b-4612-ad46-e98fdafade9f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:54.589121 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-be7821ae-477b-4612-ad46-e98fdafade9f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1371 microversion: 2.1 time: 0.184407 Sep 01 17:38:54.589992 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 186/348] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:54 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:54.731535 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-6ae85573-2b9d-4769-9078-d2a9302897dc req-e63c2bca-93a3-4c93-87f3-42b06ca679da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ef555c-0fec-491a-bc16-4e60b61a338d", "name": "network-vif-plugged", "status": "completed", "tag": "e565bb9b-eb5c-4447-9314-4a49199b5e4e"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:54.742144 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-6ae85573-2b9d-4769-9078-d2a9302897dc req-e63c2bca-93a3-4c93-87f3-42b06ca679da service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:54.742984 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-6ae85573-2b9d-4769-9078-d2a9302897dc req-e63c2bca-93a3-4c93-87f3-42b06ca679da service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:54.743702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-6ae85573-2b9d-4769-9078-d2a9302897dc req-e63c2bca-93a3-4c93-87f3-42b06ca679da service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:54.757189 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-6ae85573-2b9d-4769-9078-d2a9302897dc req-e63c2bca-93a3-4c93-87f3-42b06ca679da service nova] Creating event network-vif-plugged:e565bb9b-eb5c-4447-9314-4a49199b5e4e for instance 46ef555c-0fec-491a-bc16-4e60b61a338d on hv-cinder-83976 Sep 01 17:38:54.763385 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-6ae85573-2b9d-4769-9078-d2a9302897dc req-e63c2bca-93a3-4c93-87f3-42b06ca679da service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035525 Sep 01 17:38:54.764548 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 163/349] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:54.880853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-40ef4c6f-2204-4d2a-a739-613006ecdb79 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:54.882233 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-40ef4c6f-2204-4d2a-a739-613006ecdb79 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:54.889501 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-40ef4c6f-2204-4d2a-a739-613006ecdb79 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:54.890273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-40ef4c6f-2204-4d2a-a739-613006ecdb79 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:54.891074 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-40ef4c6f-2204-4d2a-a739-613006ecdb79 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:54.891989 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-40ef4c6f-2204-4d2a-a739-613006ecdb79 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:54.892444 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-40ef4c6f-2204-4d2a-a739-613006ecdb79 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:54.892869 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-40ef4c6f-2204-4d2a-a739-613006ecdb79 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:54.911577 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6f2b3c2c-d75f-4da1-8c4b-8e638a0b5fbc tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:54.912538 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6f2b3c2c-d75f-4da1-8c4b-8e638a0b5fbc tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] [instance: 22b3dd05-1820-4e87-a408-322f5c184899] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:54.922430 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6f2b3c2c-d75f-4da1-8c4b-8e638a0b5fbc tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:54.923245 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6f2b3c2c-d75f-4da1-8c4b-8e638a0b5fbc tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:54.923870 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6f2b3c2c-d75f-4da1-8c4b-8e638a0b5fbc tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:54.925355 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6f2b3c2c-d75f-4da1-8c4b-8e638a0b5fbc tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:54.926104 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6f2b3c2c-d75f-4da1-8c4b-8e638a0b5fbc tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:54.926766 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6f2b3c2c-d75f-4da1-8c4b-8e638a0b5fbc tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:55.196432 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-40ef4c6f-2204-4d2a-a739-613006ecdb79 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:55.207900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-40ef4c6f-2204-4d2a-a739-613006ecdb79 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.331990 Sep 01 17:38:55.209143 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 187/350] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:54 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:55.215732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-fa88ada5-ce5c-49ba-b674-5191878c4ab2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:55.216365 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-fa88ada5-ce5c-49ba-b674-5191878c4ab2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:55.232380 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fa88ada5-ce5c-49ba-b674-5191878c4ab2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:55.232990 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fa88ada5-ce5c-49ba-b674-5191878c4ab2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:55.233284 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fa88ada5-ce5c-49ba-b674-5191878c4ab2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:55.236054 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fa88ada5-ce5c-49ba-b674-5191878c4ab2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:55.236905 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fa88ada5-ce5c-49ba-b674-5191878c4ab2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:55.237493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fa88ada5-ce5c-49ba-b674-5191878c4ab2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:55.252508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-6f2b3c2c-d75f-4da1-8c4b-8e638a0b5fbc tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] HTTP exception thrown: Instance 22b3dd05-1820-4e87-a408-322f5c184899 could not be found. Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6f2b3c2c-d75f-4da1-8c4b-8e638a0b5fbc tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Request method failure captured: Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 HTTP/1.1 Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO3vjhlWCC-KStYbwXtPtKgmUxiFJSGxKAjzYJneeYvu2TYaJoOLi5OtwU7k80QSS1WrqHyT1mKhgyfgC0H8WVZEpRZWQQco04jn8A0SN4G0A9tH5pXctwq8sihhrhzFp0WaVH7n73ogm8zvNbh4DUPMFkLAQf4dmzlGoQZ8K1UTSog Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 356d731e34b24c9d8852516ae9141124 Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-VolumesActionsTest-1388464583 Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:38:55.256128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:38:55.257710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/356d731e34b24c9d8852516ae9141124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/356d731e34b24c9d8852516ae9141124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_356d731e34b24c9d8852516ae9141124"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/356d731e34b24c9d8852516ae9141124"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:38:55.257710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-VolumesActionsTest-1388464583 Sep 01 17:38:55.257710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 356d731e34b24c9d8852516ae9141124 Sep 01 17:38:55.257710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-VolumesActionsTest-1388464583 Sep 01 17:38:55.257710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-VolumesActionsTest-1388464583-project Sep 01 17:38:55.257710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:38:55.257710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:38:55.257710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: 75de510214004bbeab187d65bf178735 Sep 01 17:38:55.257710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-VolumesActionsTest-1388464583-project Sep 01 17:38:55.257710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:38:55.257710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 22b3dd05-1820-4e87-a408-322f5c184899 could not be found. Sep 01 17:38:55.257710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '22b3dd05-1820-4e87-a408-322f5c184899'} Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b3dd05-1820-4e87-a408-322f5c184899 could not be found. Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:38:55.258436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b3dd05-1820-4e87-a408-322f5c184899 could not be found. Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b3dd05-1820-4e87-a408-322f5c184899 could not be found. Sep 01 17:38:55.259832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:38:55.263037 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6f2b3c2c-d75f-4da1-8c4b-8e638a0b5fbc tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] Returning 404 to user: Instance 22b3dd05-1820-4e87-a408-322f5c184899 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:38:55.270372 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6f2b3c2c-d75f-4da1-8c4b-8e638a0b5fbc tempest-VolumesActionsTest-1388464583 tempest-VolumesActionsTest-1388464583-project] 10.222.0.100 "GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899" status: 404 len: 111 microversion: 2.1 time: 0.357819 Sep 01 17:38:55.271368 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 164/351] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:54 2022] GET /compute/v2.1/servers/22b3dd05-1820-4e87-a408-322f5c184899 => generated 111 bytes in 365 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:38:55.307003 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-7e3a7b53-3e90-4aae-bf77-1c604a250bce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:55.312243 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-7e3a7b53-3e90-4aae-bf77-1c604a250bce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:55.326610 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7e3a7b53-3e90-4aae-bf77-1c604a250bce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:55.326610 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7e3a7b53-3e90-4aae-bf77-1c604a250bce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:55.326610 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7e3a7b53-3e90-4aae-bf77-1c604a250bce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:55.326610 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7e3a7b53-3e90-4aae-bf77-1c604a250bce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:55.326980 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7e3a7b53-3e90-4aae-bf77-1c604a250bce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:55.331331 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7e3a7b53-3e90-4aae-bf77-1c604a250bce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:55.413257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-fa88ada5-ce5c-49ba-b674-5191878c4ab2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:55.423409 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-fa88ada5-ce5c-49ba-b674-5191878c4ab2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1302 microversion: 2.1 time: 0.212856 Sep 01 17:38:55.424601 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 188/352] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:55 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1302 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:55.604835 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7e3a7b53-3e90-4aae-bf77-1c604a250bce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:55.615494 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7ae9fff5-9e85-4cf4-88a2-9f1d19b610cb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:55.617609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7ae9fff5-9e85-4cf4-88a2-9f1d19b610cb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:55.621327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7e3a7b53-3e90-4aae-bf77-1c604a250bce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:55.624268 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7e3a7b53-3e90-4aae-bf77-1c604a250bce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:55.626461 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-7e3a7b53-3e90-4aae-bf77-1c604a250bce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.342649 Sep 01 17:38:55.627033 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 165/353] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:55 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:55.629365 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7ae9fff5-9e85-4cf4-88a2-9f1d19b610cb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:55.632133 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7ae9fff5-9e85-4cf4-88a2-9f1d19b610cb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:55.633223 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7ae9fff5-9e85-4cf4-88a2-9f1d19b610cb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:55.644383 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7ae9fff5-9e85-4cf4-88a2-9f1d19b610cb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:55.645334 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7ae9fff5-9e85-4cf4-88a2-9f1d19b610cb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:55.647526 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7ae9fff5-9e85-4cf4-88a2-9f1d19b610cb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:55.945498 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7ae9fff5-9e85-4cf4-88a2-9f1d19b610cb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:55.956213 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7ae9fff5-9e85-4cf4-88a2-9f1d19b610cb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1371 microversion: 2.1 time: 0.346981 Sep 01 17:38:55.957416 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 189/354] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:55 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1371 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:56.245929 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4f95efbf-e140-4c43-812e-f876fb57cfbd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:56.245929 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4f95efbf-e140-4c43-812e-f876fb57cfbd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:56.245929 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f95efbf-e140-4c43-812e-f876fb57cfbd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:56.246595 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f95efbf-e140-4c43-812e-f876fb57cfbd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:56.246595 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f95efbf-e140-4c43-812e-f876fb57cfbd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:56.247386 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f95efbf-e140-4c43-812e-f876fb57cfbd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:56.247849 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f95efbf-e140-4c43-812e-f876fb57cfbd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:56.248275 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f95efbf-e140-4c43-812e-f876fb57cfbd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:56.404625 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4f95efbf-e140-4c43-812e-f876fb57cfbd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:56.413691 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4f95efbf-e140-4c43-812e-f876fb57cfbd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.184431 Sep 01 17:38:56.414902 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 166/355] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:56 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:56.451117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-766c2e37-76dc-42a7-88bd-8fd5784f1812 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:56.451760 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-766c2e37-76dc-42a7-88bd-8fd5784f1812 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:56.457802 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-766c2e37-76dc-42a7-88bd-8fd5784f1812 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:56.458324 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-766c2e37-76dc-42a7-88bd-8fd5784f1812 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:56.458760 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-766c2e37-76dc-42a7-88bd-8fd5784f1812 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:56.459611 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-766c2e37-76dc-42a7-88bd-8fd5784f1812 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:56.460210 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-766c2e37-76dc-42a7-88bd-8fd5784f1812 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:56.461344 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-766c2e37-76dc-42a7-88bd-8fd5784f1812 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:56.528906 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-766c2e37-76dc-42a7-88bd-8fd5784f1812 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:56.537133 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-766c2e37-76dc-42a7-88bd-8fd5784f1812 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1302 microversion: 2.1 time: 0.089973 Sep 01 17:38:56.538001 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 190/356] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:56 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:56.660729 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-438c7c10-2786-46da-b45e-f59c44616508 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:56.661537 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-438c7c10-2786-46da-b45e-f59c44616508 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:56.669607 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-438c7c10-2786-46da-b45e-f59c44616508 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:56.670117 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-438c7c10-2786-46da-b45e-f59c44616508 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:56.670558 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-438c7c10-2786-46da-b45e-f59c44616508 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:56.671292 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-438c7c10-2786-46da-b45e-f59c44616508 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:56.671738 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-438c7c10-2786-46da-b45e-f59c44616508 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:56.672165 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-438c7c10-2786-46da-b45e-f59c44616508 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:56.815463 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-438c7c10-2786-46da-b45e-f59c44616508 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:56.825999 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-438c7c10-2786-46da-b45e-f59c44616508 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:56.827531 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-438c7c10-2786-46da-b45e-f59c44616508 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:56.828986 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-438c7c10-2786-46da-b45e-f59c44616508 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.172990 Sep 01 17:38:56.829795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 167/357] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:56 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:56.984160 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6857b734-8eec-4a4a-8b2b-bbf7d7439d2e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:56.984765 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6857b734-8eec-4a4a-8b2b-bbf7d7439d2e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:56.991187 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6857b734-8eec-4a4a-8b2b-bbf7d7439d2e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:56.991685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6857b734-8eec-4a4a-8b2b-bbf7d7439d2e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:56.992713 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6857b734-8eec-4a4a-8b2b-bbf7d7439d2e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:56.993494 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6857b734-8eec-4a4a-8b2b-bbf7d7439d2e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:56.993968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6857b734-8eec-4a4a-8b2b-bbf7d7439d2e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:56.994384 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6857b734-8eec-4a4a-8b2b-bbf7d7439d2e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:57.135139 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-6857b734-8eec-4a4a-8b2b-bbf7d7439d2e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:57.142748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-6857b734-8eec-4a4a-8b2b-bbf7d7439d2e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1561 microversion: 2.1 time: 0.162401 Sep 01 17:38:57.143301 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 191/358] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:56 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:57.165115 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9eb88268-4eec-438c-af32-839ff22f485c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:57.165679 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9eb88268-4eec-438c-af32-839ff22f485c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:57.173523 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9eb88268-4eec-438c-af32-839ff22f485c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:57.174314 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9eb88268-4eec-438c-af32-839ff22f485c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:57.175017 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9eb88268-4eec-438c-af32-839ff22f485c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:57.176178 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9eb88268-4eec-438c-af32-839ff22f485c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:57.176634 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9eb88268-4eec-438c-af32-839ff22f485c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:57.177400 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9eb88268-4eec-438c-af32-839ff22f485c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:57.258475 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9eb88268-4eec-438c-af32-839ff22f485c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098270 Sep 01 17:38:57.259369 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 168/359] 10.222.0.100 () {58 vars in 1280 bytes} [Thu Sep 1 17:38:57 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:57.437181 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cb0edb57-2892-47dd-9a73-72662c5153e4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:57.438126 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cb0edb57-2892-47dd-9a73-72662c5153e4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:57.444228 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb0edb57-2892-47dd-9a73-72662c5153e4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:57.445316 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb0edb57-2892-47dd-9a73-72662c5153e4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:57.445776 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb0edb57-2892-47dd-9a73-72662c5153e4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:57.446760 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb0edb57-2892-47dd-9a73-72662c5153e4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:57.447540 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb0edb57-2892-47dd-9a73-72662c5153e4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:57.448002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb0edb57-2892-47dd-9a73-72662c5153e4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:57.558797 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-aca81dad-d630-4c59-9e12-3e8e303e8c27 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:57.559571 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-aca81dad-d630-4c59-9e12-3e8e303e8c27 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:57.566554 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aca81dad-d630-4c59-9e12-3e8e303e8c27 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:57.567044 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aca81dad-d630-4c59-9e12-3e8e303e8c27 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:57.567586 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aca81dad-d630-4c59-9e12-3e8e303e8c27 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:57.568302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aca81dad-d630-4c59-9e12-3e8e303e8c27 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:57.568872 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aca81dad-d630-4c59-9e12-3e8e303e8c27 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:57.569410 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aca81dad-d630-4c59-9e12-3e8e303e8c27 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:57.664000 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-aca81dad-d630-4c59-9e12-3e8e303e8c27 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:57.672964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-aca81dad-d630-4c59-9e12-3e8e303e8c27 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1302 microversion: 2.1 time: 0.118084 Sep 01 17:38:57.674682 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 169/360] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:57 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1302 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:57.794033 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cb0edb57-2892-47dd-9a73-72662c5153e4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:57.801970 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cb0edb57-2892-47dd-9a73-72662c5153e4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.369712 Sep 01 17:38:57.802779 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 192/361] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:57 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:57.862067 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-986f0844-b1c6-4953-b7db-230b88566a99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:57.862067 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-986f0844-b1c6-4953-b7db-230b88566a99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:57.867517 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-986f0844-b1c6-4953-b7db-230b88566a99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:57.868243 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-986f0844-b1c6-4953-b7db-230b88566a99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:57.868682 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-986f0844-b1c6-4953-b7db-230b88566a99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:57.869392 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-986f0844-b1c6-4953-b7db-230b88566a99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:57.869877 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-986f0844-b1c6-4953-b7db-230b88566a99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:57.870307 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-986f0844-b1c6-4953-b7db-230b88566a99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:58.383380 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-986f0844-b1c6-4953-b7db-230b88566a99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:58.392110 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-986f0844-b1c6-4953-b7db-230b88566a99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:58.393539 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-986f0844-b1c6-4953-b7db-230b88566a99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:58.394711 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-986f0844-b1c6-4953-b7db-230b88566a99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.542346 Sep 01 17:38:58.395284 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 170/362] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:57 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:58.697151 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-240f3e69-8e47-4c60-9ede-fb16a3cf18c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:58.698401 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-240f3e69-8e47-4c60-9ede-fb16a3cf18c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:58.705611 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-240f3e69-8e47-4c60-9ede-fb16a3cf18c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:58.706092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-240f3e69-8e47-4c60-9ede-fb16a3cf18c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:58.706519 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-240f3e69-8e47-4c60-9ede-fb16a3cf18c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:58.707212 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-240f3e69-8e47-4c60-9ede-fb16a3cf18c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:58.707665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-240f3e69-8e47-4c60-9ede-fb16a3cf18c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:58.708081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-240f3e69-8e47-4c60-9ede-fb16a3cf18c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:58.824245 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ffdce5a8-8547-4ed1-a7c2-2f10af7f2d7d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:58.825368 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ffdce5a8-8547-4ed1-a7c2-2f10af7f2d7d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:58.825800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-240f3e69-8e47-4c60-9ede-fb16a3cf18c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:58.832898 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ffdce5a8-8547-4ed1-a7c2-2f10af7f2d7d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:58.833391 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ffdce5a8-8547-4ed1-a7c2-2f10af7f2d7d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:58.833877 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ffdce5a8-8547-4ed1-a7c2-2f10af7f2d7d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:58.834586 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ffdce5a8-8547-4ed1-a7c2-2f10af7f2d7d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:58.835120 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-240f3e69-8e47-4c60-9ede-fb16a3cf18c8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1302 microversion: 2.1 time: 0.142349 Sep 01 17:38:58.835239 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ffdce5a8-8547-4ed1-a7c2-2f10af7f2d7d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:58.848722 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ffdce5a8-8547-4ed1-a7c2-2f10af7f2d7d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:58.849153 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 193/363] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:58 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1302 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:58.962949 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-dfeca1c8-b817-4eeb-a872-257ecedd49b8 req-2559a606-8dd1-4c37-89f3-e23b999eb8ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48752724-82dc-4307-98af-ccc606bf5ca0", "tag": "0989218c-f26f-4809-a710-623c2a8f5c2b"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:58.972575 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-dfeca1c8-b817-4eeb-a872-257ecedd49b8 req-2559a606-8dd1-4c37-89f3-e23b999eb8ef service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:58.973044 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-dfeca1c8-b817-4eeb-a872-257ecedd49b8 req-2559a606-8dd1-4c37-89f3-e23b999eb8ef service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:58.973469 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-dfeca1c8-b817-4eeb-a872-257ecedd49b8 req-2559a606-8dd1-4c37-89f3-e23b999eb8ef service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:58.985265 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-dfeca1c8-b817-4eeb-a872-257ecedd49b8 req-2559a606-8dd1-4c37-89f3-e23b999eb8ef service nova] Creating event network-changed:0989218c-f26f-4809-a710-623c2a8f5c2b for instance 48752724-82dc-4307-98af-ccc606bf5ca0 on hv-cinder-83976 Sep 01 17:38:58.991189 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-dfeca1c8-b817-4eeb-a872-257ecedd49b8 req-2559a606-8dd1-4c37-89f3-e23b999eb8ef service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032451 Sep 01 17:38:58.992778 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 194/364] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:38:59.012319 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ffdce5a8-8547-4ed1-a7c2-2f10af7f2d7d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:59.020541 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ffdce5a8-8547-4ed1-a7c2-2f10af7f2d7d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.201673 Sep 01 17:38:59.021181 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 171/365] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:58 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:59.420197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2c656ce2-51e3-4c3b-a22e-a6f6d940eab9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:59.420896 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2c656ce2-51e3-4c3b-a22e-a6f6d940eab9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:59.427565 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2c656ce2-51e3-4c3b-a22e-a6f6d940eab9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:59.428048 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2c656ce2-51e3-4c3b-a22e-a6f6d940eab9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:59.428488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2c656ce2-51e3-4c3b-a22e-a6f6d940eab9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:59.429779 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2c656ce2-51e3-4c3b-a22e-a6f6d940eab9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:59.430469 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2c656ce2-51e3-4c3b-a22e-a6f6d940eab9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:59.430895 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2c656ce2-51e3-4c3b-a22e-a6f6d940eab9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:59.614352 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2c656ce2-51e3-4c3b-a22e-a6f6d940eab9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:59.625621 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2c656ce2-51e3-4c3b-a22e-a6f6d940eab9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:59.627542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2c656ce2-51e3-4c3b-a22e-a6f6d940eab9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:59.629296 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2c656ce2-51e3-4c3b-a22e-a6f6d940eab9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.213514 Sep 01 17:38:59.631100 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 195/366] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:59 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:38:59.857748 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-70558c01-2b16-41f4-ae04-496c5a248187 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:59.858537 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-70558c01-2b16-41f4-ae04-496c5a248187 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:59.868825 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-70558c01-2b16-41f4-ae04-496c5a248187 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:59.869314 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-70558c01-2b16-41f4-ae04-496c5a248187 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:59.869781 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-70558c01-2b16-41f4-ae04-496c5a248187 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:59.870495 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-70558c01-2b16-41f4-ae04-496c5a248187 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:59.870961 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-70558c01-2b16-41f4-ae04-496c5a248187 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:59.871384 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-70558c01-2b16-41f4-ae04-496c5a248187 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:59.959259 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-70558c01-2b16-41f4-ae04-496c5a248187 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:59.967388 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-70558c01-2b16-41f4-ae04-496c5a248187 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1302 microversion: 2.1 time: 0.114330 Sep 01 17:38:59.968282 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 172/367] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:59 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1302 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:39:00.044522 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3983e3da-51c6-4db9-867a-7b8be0515e96 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:00.045914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3983e3da-51c6-4db9-867a-7b8be0515e96 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:00.053944 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3983e3da-51c6-4db9-867a-7b8be0515e96 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:00.055098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3983e3da-51c6-4db9-867a-7b8be0515e96 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:00.055279 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3983e3da-51c6-4db9-867a-7b8be0515e96 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:00.055959 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3983e3da-51c6-4db9-867a-7b8be0515e96 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:00.056700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3983e3da-51c6-4db9-867a-7b8be0515e96 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:00.057287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3983e3da-51c6-4db9-867a-7b8be0515e96 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:00.226683 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3983e3da-51c6-4db9-867a-7b8be0515e96 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:00.239056 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3983e3da-51c6-4db9-867a-7b8be0515e96 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.199558 Sep 01 17:39:00.240070 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 196/368] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:00 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:00.653082 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bebb77c9-6f62-4131-b505-7e5348fa438e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:00.653713 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bebb77c9-6f62-4131-b505-7e5348fa438e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:00.659885 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bebb77c9-6f62-4131-b505-7e5348fa438e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:00.660365 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bebb77c9-6f62-4131-b505-7e5348fa438e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:00.660797 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bebb77c9-6f62-4131-b505-7e5348fa438e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:00.661498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bebb77c9-6f62-4131-b505-7e5348fa438e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:00.661977 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bebb77c9-6f62-4131-b505-7e5348fa438e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:00.662669 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bebb77c9-6f62-4131-b505-7e5348fa438e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:00.801427 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bebb77c9-6f62-4131-b505-7e5348fa438e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:00.810062 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bebb77c9-6f62-4131-b505-7e5348fa438e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:00.811515 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bebb77c9-6f62-4131-b505-7e5348fa438e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:00.812695 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bebb77c9-6f62-4131-b505-7e5348fa438e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.163668 Sep 01 17:39:00.813249 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 173/369] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:00 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:00.989888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-08403cfb-9a2a-4b02-b486-ea36ee92d0aa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:00.990521 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-08403cfb-9a2a-4b02-b486-ea36ee92d0aa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:00.997162 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08403cfb-9a2a-4b02-b486-ea36ee92d0aa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:00.997686 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08403cfb-9a2a-4b02-b486-ea36ee92d0aa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:00.998150 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08403cfb-9a2a-4b02-b486-ea36ee92d0aa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:00.998840 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08403cfb-9a2a-4b02-b486-ea36ee92d0aa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:00.999293 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08403cfb-9a2a-4b02-b486-ea36ee92d0aa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:00.999715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08403cfb-9a2a-4b02-b486-ea36ee92d0aa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:01.067989 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-08403cfb-9a2a-4b02-b486-ea36ee92d0aa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:01.076755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-08403cfb-9a2a-4b02-b486-ea36ee92d0aa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1302 microversion: 2.1 time: 0.090790 Sep 01 17:39:01.077513 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 197/370] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:00 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:01.261816 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-49554f2b-45f4-49f7-8db2-ec83cc971d0a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:01.262418 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-49554f2b-45f4-49f7-8db2-ec83cc971d0a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:01.268341 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49554f2b-45f4-49f7-8db2-ec83cc971d0a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:01.268818 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49554f2b-45f4-49f7-8db2-ec83cc971d0a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:01.269254 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49554f2b-45f4-49f7-8db2-ec83cc971d0a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:01.269959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49554f2b-45f4-49f7-8db2-ec83cc971d0a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:01.270408 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49554f2b-45f4-49f7-8db2-ec83cc971d0a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:01.270822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49554f2b-45f4-49f7-8db2-ec83cc971d0a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:01.295017 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:01.319001 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=5 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:01.416526 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-49554f2b-45f4-49f7-8db2-ec83cc971d0a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:01.424319 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-49554f2b-45f4-49f7-8db2-ec83cc971d0a tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.166470 Sep 01 17:39:01.424875 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 174/371] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:01 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:01.837134 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-20684757-0f8e-4578-bdbc-fe69ec752126 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:01.837680 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-20684757-0f8e-4578-bdbc-fe69ec752126 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:01.839662 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=6 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:01.845130 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-20684757-0f8e-4578-bdbc-fe69ec752126 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:01.845782 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-20684757-0f8e-4578-bdbc-fe69ec752126 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:01.846254 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-20684757-0f8e-4578-bdbc-fe69ec752126 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:01.846954 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-20684757-0f8e-4578-bdbc-fe69ec752126 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:01.847403 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-20684757-0f8e-4578-bdbc-fe69ec752126 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:01.847814 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-20684757-0f8e-4578-bdbc-fe69ec752126 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:01.985810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-20684757-0f8e-4578-bdbc-fe69ec752126 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:01.994636 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-20684757-0f8e-4578-bdbc-fe69ec752126 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:01.996075 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-20684757-0f8e-4578-bdbc-fe69ec752126 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:01.997233 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-20684757-0f8e-4578-bdbc-fe69ec752126 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.164290 Sep 01 17:39:01.997832 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 198/372] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:01 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:02.098140 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9cb6e9a6-9db9-4213-a45b-207b7516b942 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:02.099004 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9cb6e9a6-9db9-4213-a45b-207b7516b942 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:02.105313 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9cb6e9a6-9db9-4213-a45b-207b7516b942 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:02.105931 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9cb6e9a6-9db9-4213-a45b-207b7516b942 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:02.106566 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9cb6e9a6-9db9-4213-a45b-207b7516b942 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:02.107044 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9cb6e9a6-9db9-4213-a45b-207b7516b942 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:02.107495 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9cb6e9a6-9db9-4213-a45b-207b7516b942 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:02.107945 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9cb6e9a6-9db9-4213-a45b-207b7516b942 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:02.207500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9cb6e9a6-9db9-4213-a45b-207b7516b942 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:02.216320 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9cb6e9a6-9db9-4213-a45b-207b7516b942 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1302 microversion: 2.1 time: 0.122023 Sep 01 17:39:02.216908 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 175/373] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:02 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1302 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:02.446873 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-530a6475-05d8-4f3b-b0b9-9162d1e37474 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:02.447510 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-530a6475-05d8-4f3b-b0b9-9162d1e37474 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:02.454723 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-530a6475-05d8-4f3b-b0b9-9162d1e37474 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:02.455205 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-530a6475-05d8-4f3b-b0b9-9162d1e37474 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:02.455637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-530a6475-05d8-4f3b-b0b9-9162d1e37474 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:02.456343 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-530a6475-05d8-4f3b-b0b9-9162d1e37474 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:02.456795 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-530a6475-05d8-4f3b-b0b9-9162d1e37474 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:02.457214 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-530a6475-05d8-4f3b-b0b9-9162d1e37474 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:02.473348 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=100 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:02.609300 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-530a6475-05d8-4f3b-b0b9-9162d1e37474 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:02.617450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-530a6475-05d8-4f3b-b0b9-9162d1e37474 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.175650 Sep 01 17:39:02.618048 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 199/374] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:02 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:03.020330 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9ed91113-f5b8-40ad-994e-e661c4e4134f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:03.020963 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9ed91113-f5b8-40ad-994e-e661c4e4134f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:03.027758 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9ed91113-f5b8-40ad-994e-e661c4e4134f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:03.028232 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9ed91113-f5b8-40ad-994e-e661c4e4134f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:03.028667 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9ed91113-f5b8-40ad-994e-e661c4e4134f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:03.029356 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9ed91113-f5b8-40ad-994e-e661c4e4134f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:03.029910 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9ed91113-f5b8-40ad-994e-e661c4e4134f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:03.030391 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9ed91113-f5b8-40ad-994e-e661c4e4134f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:03.228095 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9ed91113-f5b8-40ad-994e-e661c4e4134f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:03.236510 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9ed91113-f5b8-40ad-994e-e661c4e4134f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:03.236802 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e09ca810-a56c-48a7-b0c5-558a79aa9551 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:03.237223 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e09ca810-a56c-48a7-b0c5-558a79aa9551 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:03.238001 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9ed91113-f5b8-40ad-994e-e661c4e4134f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:03.239274 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9ed91113-f5b8-40ad-994e-e661c4e4134f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.222786 Sep 01 17:39:03.239735 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 176/375] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:03 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:03.244776 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e09ca810-a56c-48a7-b0c5-558a79aa9551 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:03.245384 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e09ca810-a56c-48a7-b0c5-558a79aa9551 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:03.245959 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e09ca810-a56c-48a7-b0c5-558a79aa9551 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:03.246785 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e09ca810-a56c-48a7-b0c5-558a79aa9551 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:03.247394 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e09ca810-a56c-48a7-b0c5-558a79aa9551 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:03.247969 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e09ca810-a56c-48a7-b0c5-558a79aa9551 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:03.312993 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e09ca810-a56c-48a7-b0c5-558a79aa9551 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:03.321966 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e09ca810-a56c-48a7-b0c5-558a79aa9551 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1308 microversion: 2.1 time: 0.089524 Sep 01 17:39:03.322537 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 200/376] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:03 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:39:03.638710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2a6e0a35-f2b7-46a1-9f9e-c8a92589e40c tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:03.639516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2a6e0a35-f2b7-46a1-9f9e-c8a92589e40c tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:03.646508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a6e0a35-f2b7-46a1-9f9e-c8a92589e40c tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:03.647074 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a6e0a35-f2b7-46a1-9f9e-c8a92589e40c tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:03.647661 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a6e0a35-f2b7-46a1-9f9e-c8a92589e40c tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:03.648516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a6e0a35-f2b7-46a1-9f9e-c8a92589e40c tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:03.649076 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a6e0a35-f2b7-46a1-9f9e-c8a92589e40c tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:03.649820 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a6e0a35-f2b7-46a1-9f9e-c8a92589e40c tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:03.990249 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2a6e0a35-f2b7-46a1-9f9e-c8a92589e40c tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:04.007351 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2a6e0a35-f2b7-46a1-9f9e-c8a92589e40c tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1323 microversion: 2.1 time: 0.372452 Sep 01 17:39:04.025599 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 177/377] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:03 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1323 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:04.263236 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ad3d2bc7-221d-41f3-bfbc-113a415c97c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:04.265021 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ad3d2bc7-221d-41f3-bfbc-113a415c97c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:04.272143 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3d2bc7-221d-41f3-bfbc-113a415c97c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:04.272837 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3d2bc7-221d-41f3-bfbc-113a415c97c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:04.273486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3d2bc7-221d-41f3-bfbc-113a415c97c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:04.274552 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3d2bc7-221d-41f3-bfbc-113a415c97c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:04.275279 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3d2bc7-221d-41f3-bfbc-113a415c97c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:04.275973 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3d2bc7-221d-41f3-bfbc-113a415c97c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:04.343778 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d67fd6f7-fd68-4936-bc3a-b9c764965a5d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:04.344529 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d67fd6f7-fd68-4936-bc3a-b9c764965a5d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:04.353853 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d67fd6f7-fd68-4936-bc3a-b9c764965a5d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:04.354536 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d67fd6f7-fd68-4936-bc3a-b9c764965a5d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:04.354982 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d67fd6f7-fd68-4936-bc3a-b9c764965a5d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:04.355706 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d67fd6f7-fd68-4936-bc3a-b9c764965a5d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:04.356375 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d67fd6f7-fd68-4936-bc3a-b9c764965a5d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:04.359793 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d67fd6f7-fd68-4936-bc3a-b9c764965a5d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:04.455194 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d67fd6f7-fd68-4936-bc3a-b9c764965a5d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:04.460032 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=100 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:04.466535 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d67fd6f7-fd68-4936-bc3a-b9c764965a5d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1308 microversion: 2.1 time: 0.126955 Sep 01 17:39:04.467367 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 178/378] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:04 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1308 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:39:04.560940 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ad3d2bc7-221d-41f3-bfbc-113a415c97c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:04.574076 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ad3d2bc7-221d-41f3-bfbc-113a415c97c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:04.575792 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ad3d2bc7-221d-41f3-bfbc-113a415c97c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:04.582965 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ad3d2bc7-221d-41f3-bfbc-113a415c97c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.318153 Sep 01 17:39:04.583615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 201/379] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:04 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:05.037941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c1759fa2-2f39-420f-8f6e-b7a1c92e5034 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:05.039688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c1759fa2-2f39-420f-8f6e-b7a1c92e5034 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:05.049771 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c1759fa2-2f39-420f-8f6e-b7a1c92e5034 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:05.050528 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c1759fa2-2f39-420f-8f6e-b7a1c92e5034 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:05.051154 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c1759fa2-2f39-420f-8f6e-b7a1c92e5034 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:05.052212 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c1759fa2-2f39-420f-8f6e-b7a1c92e5034 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:05.053027 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c1759fa2-2f39-420f-8f6e-b7a1c92e5034 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:05.053828 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c1759fa2-2f39-420f-8f6e-b7a1c92e5034 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:05.344763 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c1759fa2-2f39-420f-8f6e-b7a1c92e5034 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:05.364566 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c1759fa2-2f39-420f-8f6e-b7a1c92e5034 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1512 microversion: 2.1 time: 0.334446 Sep 01 17:39:05.365225 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 179/380] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:05 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1512 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:05.489506 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7e4c87f3-877a-4b17-9d3c-90f3c1f7c008 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:05.490778 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7e4c87f3-877a-4b17-9d3c-90f3c1f7c008 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:05.497565 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7e4c87f3-877a-4b17-9d3c-90f3c1f7c008 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:05.498380 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7e4c87f3-877a-4b17-9d3c-90f3c1f7c008 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:05.498827 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7e4c87f3-877a-4b17-9d3c-90f3c1f7c008 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:05.499549 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7e4c87f3-877a-4b17-9d3c-90f3c1f7c008 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:05.500182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7e4c87f3-877a-4b17-9d3c-90f3c1f7c008 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:05.500777 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7e4c87f3-877a-4b17-9d3c-90f3c1f7c008 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:05.607471 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-63e39e56-3fbf-4091-a48f-066dfe80b3b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:05.608371 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-63e39e56-3fbf-4091-a48f-066dfe80b3b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:05.615231 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-63e39e56-3fbf-4091-a48f-066dfe80b3b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:05.616075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-63e39e56-3fbf-4091-a48f-066dfe80b3b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:05.616736 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-63e39e56-3fbf-4091-a48f-066dfe80b3b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:05.617465 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-63e39e56-3fbf-4091-a48f-066dfe80b3b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:05.617969 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-63e39e56-3fbf-4091-a48f-066dfe80b3b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:05.618453 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-63e39e56-3fbf-4091-a48f-066dfe80b3b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:06.109194 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7e4c87f3-877a-4b17-9d3c-90f3c1f7c008 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:06.119352 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7e4c87f3-877a-4b17-9d3c-90f3c1f7c008 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1376 microversion: 2.1 time: 0.632926 Sep 01 17:39:06.120765 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 202/381] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:05 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1376 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:06.212552 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-63e39e56-3fbf-4091-a48f-066dfe80b3b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:06.227392 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-63e39e56-3fbf-4091-a48f-066dfe80b3b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:06.232093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-63e39e56-3fbf-4091-a48f-066dfe80b3b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:06.234275 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-63e39e56-3fbf-4091-a48f-066dfe80b3b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.630680 Sep 01 17:39:06.237933 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 180/382] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:05 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:06.282126 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-2002a90e-e10f-4321-9ec0-722a77b6d890 req-0711fe7a-ac09-4d2d-b1e9-bc20000e13bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd635ada-9195-43da-a0a3-b131c9132dd6", "tag": "9345839b-552d-4f2c-8201-39a0d79147af"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:06.302974 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-2002a90e-e10f-4321-9ec0-722a77b6d890 req-0711fe7a-ac09-4d2d-b1e9-bc20000e13bb service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:06.303457 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-2002a90e-e10f-4321-9ec0-722a77b6d890 req-0711fe7a-ac09-4d2d-b1e9-bc20000e13bb service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:06.303942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-2002a90e-e10f-4321-9ec0-722a77b6d890 req-0711fe7a-ac09-4d2d-b1e9-bc20000e13bb service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:06.330916 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-2002a90e-e10f-4321-9ec0-722a77b6d890 req-0711fe7a-ac09-4d2d-b1e9-bc20000e13bb service nova] Creating event network-changed:9345839b-552d-4f2c-8201-39a0d79147af for instance fd635ada-9195-43da-a0a3-b131c9132dd6 on hv-cinder-83976 Sep 01 17:39:06.339286 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-2002a90e-e10f-4321-9ec0-722a77b6d890 req-0711fe7a-ac09-4d2d-b1e9-bc20000e13bb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061789 Sep 01 17:39:06.340208 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 203/383] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:07.142413 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6ce85eeb-6098-458f-9636-79687904f252 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:07.143140 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6ce85eeb-6098-458f-9636-79687904f252 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:07.152099 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ce85eeb-6098-458f-9636-79687904f252 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:07.154168 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ce85eeb-6098-458f-9636-79687904f252 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:07.155377 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ce85eeb-6098-458f-9636-79687904f252 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:07.156114 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ce85eeb-6098-458f-9636-79687904f252 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:07.156567 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ce85eeb-6098-458f-9636-79687904f252 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:07.157180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ce85eeb-6098-458f-9636-79687904f252 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:07.264087 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a08104b7-475b-49bd-937f-80ade2ea3be3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:07.265213 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a08104b7-475b-49bd-937f-80ade2ea3be3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:07.278083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a08104b7-475b-49bd-937f-80ade2ea3be3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:07.279298 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a08104b7-475b-49bd-937f-80ade2ea3be3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:07.279903 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a08104b7-475b-49bd-937f-80ade2ea3be3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:07.280932 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a08104b7-475b-49bd-937f-80ade2ea3be3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:07.281895 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a08104b7-475b-49bd-937f-80ade2ea3be3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:07.282871 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a08104b7-475b-49bd-937f-80ade2ea3be3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:07.412827 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6ce85eeb-6098-458f-9636-79687904f252 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:07.426020 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6ce85eeb-6098-458f-9636-79687904f252 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1376 microversion: 2.1 time: 0.288080 Sep 01 17:39:07.431040 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 181/384] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:07 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1376 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:07.570367 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a08104b7-475b-49bd-937f-80ade2ea3be3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:07.582967 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a08104b7-475b-49bd-937f-80ade2ea3be3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:07.584798 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a08104b7-475b-49bd-937f-80ade2ea3be3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:07.587134 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a08104b7-475b-49bd-937f-80ade2ea3be3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.329875 Sep 01 17:39:07.597664 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 204/385] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:07 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:08.453892 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f3c1be02-997d-445a-bf11-e91282047c67 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:08.454671 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f3c1be02-997d-445a-bf11-e91282047c67 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:08.461557 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f3c1be02-997d-445a-bf11-e91282047c67 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:08.462535 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f3c1be02-997d-445a-bf11-e91282047c67 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:08.463210 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f3c1be02-997d-445a-bf11-e91282047c67 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:08.464178 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f3c1be02-997d-445a-bf11-e91282047c67 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:08.464862 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f3c1be02-997d-445a-bf11-e91282047c67 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:08.465506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f3c1be02-997d-445a-bf11-e91282047c67 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:08.614777 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d8bb4098-67c3-4317-939c-ef66e76973e3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:08.616455 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d8bb4098-67c3-4317-939c-ef66e76973e3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:08.646345 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d8bb4098-67c3-4317-939c-ef66e76973e3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:08.647458 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d8bb4098-67c3-4317-939c-ef66e76973e3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:08.648864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d8bb4098-67c3-4317-939c-ef66e76973e3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:08.650222 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d8bb4098-67c3-4317-939c-ef66e76973e3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:08.651096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d8bb4098-67c3-4317-939c-ef66e76973e3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:08.651819 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d8bb4098-67c3-4317-939c-ef66e76973e3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:08.875630 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f3c1be02-997d-445a-bf11-e91282047c67 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:08.889192 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f3c1be02-997d-445a-bf11-e91282047c67 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1376 microversion: 2.1 time: 0.439077 Sep 01 17:39:08.890770 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 182/386] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:08 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1376 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:09.028422 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d8bb4098-67c3-4317-939c-ef66e76973e3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:09.048443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d8bb4098-67c3-4317-939c-ef66e76973e3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:09.050133 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d8bb4098-67c3-4317-939c-ef66e76973e3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:09.053167 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d8bb4098-67c3-4317-939c-ef66e76973e3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.442908 Sep 01 17:39:09.069855 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 205/387] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:08 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:09.914668 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9a1ebeaa-8727-457e-a13e-f8acaa6d4f4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:09.916116 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9a1ebeaa-8727-457e-a13e-f8acaa6d4f4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:09.922533 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a1ebeaa-8727-457e-a13e-f8acaa6d4f4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:09.923299 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a1ebeaa-8727-457e-a13e-f8acaa6d4f4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:09.923927 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a1ebeaa-8727-457e-a13e-f8acaa6d4f4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:09.924817 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a1ebeaa-8727-457e-a13e-f8acaa6d4f4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:09.925279 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a1ebeaa-8727-457e-a13e-f8acaa6d4f4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:09.925731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a1ebeaa-8727-457e-a13e-f8acaa6d4f4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:10.077367 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0e2622b2-24d4-4d45-b112-3cff621ced69 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:10.078186 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0e2622b2-24d4-4d45-b112-3cff621ced69 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:10.085958 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e2622b2-24d4-4d45-b112-3cff621ced69 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:10.086853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e2622b2-24d4-4d45-b112-3cff621ced69 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:10.087369 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e2622b2-24d4-4d45-b112-3cff621ced69 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:10.088155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e2622b2-24d4-4d45-b112-3cff621ced69 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:10.088793 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e2622b2-24d4-4d45-b112-3cff621ced69 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:10.089442 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e2622b2-24d4-4d45-b112-3cff621ced69 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:10.194895 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9a1ebeaa-8727-457e-a13e-f8acaa6d4f4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:10.208825 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9a1ebeaa-8727-457e-a13e-f8acaa6d4f4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1376 microversion: 2.1 time: 0.299300 Sep 01 17:39:10.209568 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 183/388] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:09 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1376 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:39:10.343554 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0e2622b2-24d4-4d45-b112-3cff621ced69 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:10.389045 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0e2622b2-24d4-4d45-b112-3cff621ced69 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:10.418012 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0e2622b2-24d4-4d45-b112-3cff621ced69 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:10.423640 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0e2622b2-24d4-4d45-b112-3cff621ced69 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1749 microversion: 2.20 time: 0.348896 Sep 01 17:39:10.475429 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 206/389] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:10 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1749 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:11.251556 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-03f9b3fe-81d0-4fc2-8676-d9a68755a71c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:11.257568 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-03f9b3fe-81d0-4fc2-8676-d9a68755a71c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:11.292004 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-03f9b3fe-81d0-4fc2-8676-d9a68755a71c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:11.297532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-03f9b3fe-81d0-4fc2-8676-d9a68755a71c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:11.298776 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-03f9b3fe-81d0-4fc2-8676-d9a68755a71c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:11.305230 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-03f9b3fe-81d0-4fc2-8676-d9a68755a71c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:11.306046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-03f9b3fe-81d0-4fc2-8676-d9a68755a71c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:11.306712 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-03f9b3fe-81d0-4fc2-8676-d9a68755a71c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:11.466552 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5ac8a3f4-9692-4438-ad7f-391175f5d1a9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:11.469865 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5ac8a3f4-9692-4438-ad7f-391175f5d1a9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:11.497650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5ac8a3f4-9692-4438-ad7f-391175f5d1a9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:11.499516 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5ac8a3f4-9692-4438-ad7f-391175f5d1a9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:11.504947 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5ac8a3f4-9692-4438-ad7f-391175f5d1a9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:11.508348 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5ac8a3f4-9692-4438-ad7f-391175f5d1a9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:11.509289 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5ac8a3f4-9692-4438-ad7f-391175f5d1a9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:11.510136 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5ac8a3f4-9692-4438-ad7f-391175f5d1a9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:11.783148 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-03f9b3fe-81d0-4fc2-8676-d9a68755a71c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:11.797468 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-03f9b3fe-81d0-4fc2-8676-d9a68755a71c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1376 microversion: 2.1 time: 0.559814 Sep 01 17:39:11.814540 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 184/390] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:11 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1376 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:12.055352 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5ac8a3f4-9692-4438-ad7f-391175f5d1a9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:12.065258 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5ac8a3f4-9692-4438-ad7f-391175f5d1a9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:12.066986 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5ac8a3f4-9692-4438-ad7f-391175f5d1a9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:12.068164 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5ac8a3f4-9692-4438-ad7f-391175f5d1a9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1749 microversion: 2.20 time: 0.617688 Sep 01 17:39:12.068719 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 207/391] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:11 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1749 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:12.384041 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-d43e4b9f-f5e6-420a-bbba-44a98062f97d req-e8446ac7-afab-43e0-a6a0-74748aaf8134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd635ada-9195-43da-a0a3-b131c9132dd6", "name": "network-vif-plugged", "status": "completed", "tag": "9345839b-552d-4f2c-8201-39a0d79147af"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:12.402647 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-d43e4b9f-f5e6-420a-bbba-44a98062f97d req-e8446ac7-afab-43e0-a6a0-74748aaf8134 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:12.403169 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-d43e4b9f-f5e6-420a-bbba-44a98062f97d req-e8446ac7-afab-43e0-a6a0-74748aaf8134 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:12.403620 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-d43e4b9f-f5e6-420a-bbba-44a98062f97d req-e8446ac7-afab-43e0-a6a0-74748aaf8134 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:12.430978 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-d43e4b9f-f5e6-420a-bbba-44a98062f97d req-e8446ac7-afab-43e0-a6a0-74748aaf8134 service nova] Creating event network-vif-plugged:9345839b-552d-4f2c-8201-39a0d79147af for instance fd635ada-9195-43da-a0a3-b131c9132dd6 on hv-cinder-83976 Sep 01 17:39:12.436920 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-d43e4b9f-f5e6-420a-bbba-44a98062f97d req-e8446ac7-afab-43e0-a6a0-74748aaf8134 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057182 Sep 01 17:39:12.437868 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 185/392] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:12.826643 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8fda39fd-0946-4560-952c-229bcac90eb3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:12.827820 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8fda39fd-0946-4560-952c-229bcac90eb3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:12.853615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8fda39fd-0946-4560-952c-229bcac90eb3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:12.854201 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8fda39fd-0946-4560-952c-229bcac90eb3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:12.854726 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8fda39fd-0946-4560-952c-229bcac90eb3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:12.855709 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8fda39fd-0946-4560-952c-229bcac90eb3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:12.856437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8fda39fd-0946-4560-952c-229bcac90eb3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:12.856938 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8fda39fd-0946-4560-952c-229bcac90eb3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:13.093567 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-68b6df2f-3e18-4703-8f76-f4c414a7be36 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:13.096225 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-68b6df2f-3e18-4703-8f76-f4c414a7be36 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:13.110193 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68b6df2f-3e18-4703-8f76-f4c414a7be36 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:13.115529 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68b6df2f-3e18-4703-8f76-f4c414a7be36 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:13.117946 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68b6df2f-3e18-4703-8f76-f4c414a7be36 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:13.119045 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68b6df2f-3e18-4703-8f76-f4c414a7be36 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:13.119526 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68b6df2f-3e18-4703-8f76-f4c414a7be36 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:13.120056 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68b6df2f-3e18-4703-8f76-f4c414a7be36 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:13.130236 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8fda39fd-0946-4560-952c-229bcac90eb3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:13.156141 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8fda39fd-0946-4560-952c-229bcac90eb3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1376 microversion: 2.1 time: 0.336843 Sep 01 17:39:13.179891 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 208/393] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:12 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1376 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:13.729988 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-68b6df2f-3e18-4703-8f76-f4c414a7be36 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:13.743142 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-68b6df2f-3e18-4703-8f76-f4c414a7be36 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:13.745893 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-68b6df2f-3e18-4703-8f76-f4c414a7be36 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:13.747451 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-68b6df2f-3e18-4703-8f76-f4c414a7be36 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.658675 Sep 01 17:39:13.748781 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 186/394] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:13 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:14.184095 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4d2a5cfa-c6b7-4a15-bd82-35d7e1ea9d19 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:14.184743 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4d2a5cfa-c6b7-4a15-bd82-35d7e1ea9d19 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:14.193892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4d2a5cfa-c6b7-4a15-bd82-35d7e1ea9d19 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:14.194934 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4d2a5cfa-c6b7-4a15-bd82-35d7e1ea9d19 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:14.195420 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4d2a5cfa-c6b7-4a15-bd82-35d7e1ea9d19 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:14.196598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4d2a5cfa-c6b7-4a15-bd82-35d7e1ea9d19 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:14.197533 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4d2a5cfa-c6b7-4a15-bd82-35d7e1ea9d19 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:14.198183 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4d2a5cfa-c6b7-4a15-bd82-35d7e1ea9d19 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:14.378756 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4d2a5cfa-c6b7-4a15-bd82-35d7e1ea9d19 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:14.391287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4d2a5cfa-c6b7-4a15-bd82-35d7e1ea9d19 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1376 microversion: 2.1 time: 0.211247 Sep 01 17:39:14.401706 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 209/395] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:14 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1376 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:14.779370 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2494ef30-dbd1-4463-8a35-0e86aee78313 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:14.780800 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2494ef30-dbd1-4463-8a35-0e86aee78313 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:14.792423 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2494ef30-dbd1-4463-8a35-0e86aee78313 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:14.794278 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2494ef30-dbd1-4463-8a35-0e86aee78313 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:14.795152 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2494ef30-dbd1-4463-8a35-0e86aee78313 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:14.817281 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2494ef30-dbd1-4463-8a35-0e86aee78313 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:14.822001 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2494ef30-dbd1-4463-8a35-0e86aee78313 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:14.823687 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2494ef30-dbd1-4463-8a35-0e86aee78313 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:15.143620 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2494ef30-dbd1-4463-8a35-0e86aee78313 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:15.159064 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2494ef30-dbd1-4463-8a35-0e86aee78313 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:15.177906 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2494ef30-dbd1-4463-8a35-0e86aee78313 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:15.179353 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2494ef30-dbd1-4463-8a35-0e86aee78313 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.405538 Sep 01 17:39:15.181456 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 187/396] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:14 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:15.259064 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1533684257", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-41354798", "security_groups": [{"name": "tempest-secgroup-smoke-442840094"}], "networks": [{"uuid": "0e6962fa-62d8-4a21-9599-2ad0d9e497f1"}], "block_device_mapping_v2": [{"uuid": "123614f4-a93c-47e8-a041-ecdc634ca1d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:15.414847 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-27589bdc-c0a1-47cd-814f-b60b8e642941 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:15.416400 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-27589bdc-c0a1-47cd-814f-b60b8e642941 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:15.426529 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-27589bdc-c0a1-47cd-814f-b60b8e642941 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:15.430708 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-27589bdc-c0a1-47cd-814f-b60b8e642941 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:15.431641 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-27589bdc-c0a1-47cd-814f-b60b8e642941 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:15.432845 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-27589bdc-c0a1-47cd-814f-b60b8e642941 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:15.433739 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-27589bdc-c0a1-47cd-814f-b60b8e642941 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:15.434347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-27589bdc-c0a1-47cd-814f-b60b8e642941 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:15.504273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.network.neutron [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] validate_networks() for [('0e6962fa-62d8-4a21-9599-2ad0d9e497f1', None, None, None, None, None)] {{(pid=127233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:39:15.816878 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-27589bdc-c0a1-47cd-814f-b60b8e642941 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:15.836227 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-27589bdc-c0a1-47cd-814f-b60b8e642941 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1571 microversion: 2.1 time: 0.421921 Sep 01 17:39:15.837446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 188/397] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:15 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1571 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:39:15.863979 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a29d9a6d-2480-4092-860e-549c658d9571 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:15.864849 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a29d9a6d-2480-4092-860e-549c658d9571 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:15.872459 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a29d9a6d-2480-4092-860e-549c658d9571 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:15.873263 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a29d9a6d-2480-4092-860e-549c658d9571 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:15.873991 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a29d9a6d-2480-4092-860e-549c658d9571 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:15.874916 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a29d9a6d-2480-4092-860e-549c658d9571 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:15.875753 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a29d9a6d-2480-4092-860e-549c658d9571 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:15.876474 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a29d9a6d-2480-4092-860e-549c658d9571 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:16.079088 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a29d9a6d-2480-4092-860e-549c658d9571 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.219053 Sep 01 17:39:16.080519 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 189/398] 10.222.0.100 () {58 vars in 1280 bytes} [Thu Sep 1 17:39:15 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-interface => generated 285 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:39:16.208769 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bbaa2959-de06-44b5-8caa-23cacb7fa5f4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:16.209686 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bbaa2959-de06-44b5-8caa-23cacb7fa5f4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:16.225019 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbaa2959-de06-44b5-8caa-23cacb7fa5f4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:16.226941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbaa2959-de06-44b5-8caa-23cacb7fa5f4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:16.230534 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbaa2959-de06-44b5-8caa-23cacb7fa5f4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:16.231489 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbaa2959-de06-44b5-8caa-23cacb7fa5f4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:16.232101 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbaa2959-de06-44b5-8caa-23cacb7fa5f4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:16.233084 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbaa2959-de06-44b5-8caa-23cacb7fa5f4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:16.762651 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bbaa2959-de06-44b5-8caa-23cacb7fa5f4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:16.781736 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bbaa2959-de06-44b5-8caa-23cacb7fa5f4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:16.790060 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bbaa2959-de06-44b5-8caa-23cacb7fa5f4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:16.792196 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bbaa2959-de06-44b5-8caa-23cacb7fa5f4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.587950 Sep 01 17:39:16.797173 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 190/399] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:16 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:17.006529 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-a29f0f3a-132c-4e88-a900-37403ce1e22a req-0e9ecb1f-dcf7-4387-a6c7-35a268c28219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc52ad3-09b3-4851-8a50-ad446bd1a75d", "name": "network-vif-plugged", "status": "completed", "tag": "be99e7bf-5f6d-42df-82e3-b77a04fd7684"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:17.067633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-a29f0f3a-132c-4e88-a900-37403ce1e22a req-0e9ecb1f-dcf7-4387-a6c7-35a268c28219 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:17.068123 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-a29f0f3a-132c-4e88-a900-37403ce1e22a req-0e9ecb1f-dcf7-4387-a6c7-35a268c28219 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:17.068556 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-a29f0f3a-132c-4e88-a900-37403ce1e22a req-0e9ecb1f-dcf7-4387-a6c7-35a268c28219 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:17.100694 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-a29f0f3a-132c-4e88-a900-37403ce1e22a req-0e9ecb1f-dcf7-4387-a6c7-35a268c28219 service nova] Creating event network-vif-plugged:be99e7bf-5f6d-42df-82e3-b77a04fd7684 for instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d on hv-cinder-83976 Sep 01 17:39:17.114565 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-a29f0f3a-132c-4e88-a900-37403ce1e22a req-0e9ecb1f-dcf7-4387-a6c7-35a268c28219 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126012 Sep 01 17:39:17.115169 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 191/400] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:39:17.224108 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Flavor limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:39:17.224627 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Image limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:39:17.225152 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Flavor pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:39:17.225905 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Image pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:39:17.226409 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:39:17.244067 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:17.246779 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:17.248572 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:17.250797 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:17.252949 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:17.254255 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:17.284104 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Getting quotas for project b3f3bf24fbbd42919ad87cc04e4f6042. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:39:17.290672 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Getting quotas for user 289058107592455fbf5af315fba7a126 and project b3f3bf24fbbd42919ad87cc04e4f6042. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:39:17.453763 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Going to run 1 instances... {{(pid=127233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:39:17.458592 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='123614f4-a93c-47e8-a041-ecdc634ca1d9',volume_size=None,volume_type=None)] {{(pid=127233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:39:17.753951 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-fd52813c-34f2-4f51-9c5f-cdb1f94f4ecf tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.500278 Sep 01 17:39:17.761695 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 210/401] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:39:15 2022] POST /compute/v2.1/servers => generated 407 bytes in 2509 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:39:17.768197 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ed4bacba-feca-444b-9555-425c0c3c552b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:17.769275 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ed4bacba-feca-444b-9555-425c0c3c552b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:17.825615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-13aa7781-f405-4a98-8ece-24720d1a7931 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:17.826492 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-13aa7781-f405-4a98-8ece-24720d1a7931 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:17.846121 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-13aa7781-f405-4a98-8ece-24720d1a7931 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:17.846929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-13aa7781-f405-4a98-8ece-24720d1a7931 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:17.847798 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-13aa7781-f405-4a98-8ece-24720d1a7931 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:17.848666 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-13aa7781-f405-4a98-8ece-24720d1a7931 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:17.849273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-13aa7781-f405-4a98-8ece-24720d1a7931 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:17.849899 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-13aa7781-f405-4a98-8ece-24720d1a7931 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:18.016635 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ed4bacba-feca-444b-9555-425c0c3c552b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:18.030252 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ed4bacba-feca-444b-9555-425c0c3c552b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1090 microversion: 2.1 time: 0.266563 Sep 01 17:39:18.046611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 192/402] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:17 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1090 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:18.328765 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-13aa7781-f405-4a98-8ece-24720d1a7931 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:18.342241 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-13aa7781-f405-4a98-8ece-24720d1a7931 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:18.348771 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-13aa7781-f405-4a98-8ece-24720d1a7931 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:18.350541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-13aa7781-f405-4a98-8ece-24720d1a7931 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.529525 Sep 01 17:39:18.363533 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 211/403] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:17 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:19.059645 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cfa349e5-0951-428d-9344-b8348bb97481 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:19.060417 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-cfa349e5-0951-428d-9344-b8348bb97481 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:19.072776 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cfa349e5-0951-428d-9344-b8348bb97481 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:19.076033 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cfa349e5-0951-428d-9344-b8348bb97481 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:19.077111 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cfa349e5-0951-428d-9344-b8348bb97481 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:19.080063 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cfa349e5-0951-428d-9344-b8348bb97481 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:19.080870 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cfa349e5-0951-428d-9344-b8348bb97481 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:19.081500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cfa349e5-0951-428d-9344-b8348bb97481 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:19.389345 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-854f2b41-8bfe-4844-b6d6-81cab9b4bcaf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:19.390593 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-854f2b41-8bfe-4844-b6d6-81cab9b4bcaf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:19.409257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-854f2b41-8bfe-4844-b6d6-81cab9b4bcaf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:19.410258 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-854f2b41-8bfe-4844-b6d6-81cab9b4bcaf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:19.412138 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-854f2b41-8bfe-4844-b6d6-81cab9b4bcaf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:19.414537 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-854f2b41-8bfe-4844-b6d6-81cab9b4bcaf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:19.416338 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-854f2b41-8bfe-4844-b6d6-81cab9b4bcaf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:19.418203 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-854f2b41-8bfe-4844-b6d6-81cab9b4bcaf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:19.737954 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-cfa349e5-0951-428d-9344-b8348bb97481 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:19.752478 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-cfa349e5-0951-428d-9344-b8348bb97481 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1188 microversion: 2.1 time: 0.703099 Sep 01 17:39:19.756163 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 193/404] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:19 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1188 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:19.809224 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-8dfaef4f-5c78-4d04-bc0c-8ca572cc445a req-c514dfcb-5645-4277-ac8a-2aea223dd72b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd635ada-9195-43da-a0a3-b131c9132dd6", "tag": "9345839b-552d-4f2c-8201-39a0d79147af"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:19.838217 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-8dfaef4f-5c78-4d04-bc0c-8ca572cc445a req-c514dfcb-5645-4277-ac8a-2aea223dd72b service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:19.842800 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-8dfaef4f-5c78-4d04-bc0c-8ca572cc445a req-c514dfcb-5645-4277-ac8a-2aea223dd72b service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:19.847990 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-8dfaef4f-5c78-4d04-bc0c-8ca572cc445a req-c514dfcb-5645-4277-ac8a-2aea223dd72b service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:19.887560 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-8dfaef4f-5c78-4d04-bc0c-8ca572cc445a req-c514dfcb-5645-4277-ac8a-2aea223dd72b service nova] Creating event network-changed:9345839b-552d-4f2c-8201-39a0d79147af for instance fd635ada-9195-43da-a0a3-b131c9132dd6 on hv-cinder-83976 Sep 01 17:39:19.901620 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-854f2b41-8bfe-4844-b6d6-81cab9b4bcaf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:19.918069 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-8dfaef4f-5c78-4d04-bc0c-8ca572cc445a req-c514dfcb-5645-4277-ac8a-2aea223dd72b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112704 Sep 01 17:39:19.918610 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-854f2b41-8bfe-4844-b6d6-81cab9b4bcaf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:19.920802 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-854f2b41-8bfe-4844-b6d6-81cab9b4bcaf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:19.925168 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 194/405] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:19.926696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-854f2b41-8bfe-4844-b6d6-81cab9b4bcaf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.549988 Sep 01 17:39:19.927376 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 212/406] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:19 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:39:20.790234 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d757e0dd-41f6-4cfa-a488-c94034a8a5f1 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:20.791742 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d757e0dd-41f6-4cfa-a488-c94034a8a5f1 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:20.804307 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d757e0dd-41f6-4cfa-a488-c94034a8a5f1 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:20.809509 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d757e0dd-41f6-4cfa-a488-c94034a8a5f1 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:20.811065 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d757e0dd-41f6-4cfa-a488-c94034a8a5f1 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:20.812471 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d757e0dd-41f6-4cfa-a488-c94034a8a5f1 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:20.813211 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d757e0dd-41f6-4cfa-a488-c94034a8a5f1 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:20.814079 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d757e0dd-41f6-4cfa-a488-c94034a8a5f1 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:20.966335 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4a44e086-938e-47a8-a418-76ea0bee2c6b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:20.968107 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4a44e086-938e-47a8-a418-76ea0bee2c6b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:21.041130 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a44e086-938e-47a8-a418-76ea0bee2c6b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:21.041130 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a44e086-938e-47a8-a418-76ea0bee2c6b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:21.041130 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a44e086-938e-47a8-a418-76ea0bee2c6b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:21.041130 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a44e086-938e-47a8-a418-76ea0bee2c6b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:21.043700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a44e086-938e-47a8-a418-76ea0bee2c6b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:21.044227 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a44e086-938e-47a8-a418-76ea0bee2c6b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:21.066206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d757e0dd-41f6-4cfa-a488-c94034a8a5f1 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:21.090857 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d757e0dd-41f6-4cfa-a488-c94034a8a5f1 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1206 microversion: 2.1 time: 0.302987 Sep 01 17:39:21.115422 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 195/407] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:20 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1206 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:21.568541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4a44e086-938e-47a8-a418-76ea0bee2c6b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:21.578930 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4a44e086-938e-47a8-a418-76ea0bee2c6b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:21.591544 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4a44e086-938e-47a8-a418-76ea0bee2c6b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:21.593381 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4a44e086-938e-47a8-a418-76ea0bee2c6b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.635565 Sep 01 17:39:21.594248 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 213/408] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:20 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:22.136747 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d896a2b6-aa25-45cc-8978-029e76b71029 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:22.139099 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d896a2b6-aa25-45cc-8978-029e76b71029 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:22.151350 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d896a2b6-aa25-45cc-8978-029e76b71029 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:22.152408 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d896a2b6-aa25-45cc-8978-029e76b71029 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:22.153198 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d896a2b6-aa25-45cc-8978-029e76b71029 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:22.154387 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d896a2b6-aa25-45cc-8978-029e76b71029 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:22.155405 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d896a2b6-aa25-45cc-8978-029e76b71029 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:22.156068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d896a2b6-aa25-45cc-8978-029e76b71029 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:22.409346 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d896a2b6-aa25-45cc-8978-029e76b71029 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:22.426679 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d896a2b6-aa25-45cc-8978-029e76b71029 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1194 microversion: 2.1 time: 0.303028 Sep 01 17:39:22.427733 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 196/409] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:22 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:22.622294 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cef68b34-313a-488c-a8d6-3f7ceec80d3c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:22.626147 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cef68b34-313a-488c-a8d6-3f7ceec80d3c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:22.654380 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:22.671891 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cef68b34-313a-488c-a8d6-3f7ceec80d3c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:22.672852 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cef68b34-313a-488c-a8d6-3f7ceec80d3c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:22.685550 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cef68b34-313a-488c-a8d6-3f7ceec80d3c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:22.691855 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cef68b34-313a-488c-a8d6-3f7ceec80d3c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:22.692804 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cef68b34-313a-488c-a8d6-3f7ceec80d3c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:22.694966 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cef68b34-313a-488c-a8d6-3f7ceec80d3c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:23.462905 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-979e9578-1069-4183-831f-70685de0ef70 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:23.464536 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-979e9578-1069-4183-831f-70685de0ef70 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:23.486309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=78 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:23.494402 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-979e9578-1069-4183-831f-70685de0ef70 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:23.500398 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-979e9578-1069-4183-831f-70685de0ef70 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:23.501210 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-979e9578-1069-4183-831f-70685de0ef70 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:23.503436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-979e9578-1069-4183-831f-70685de0ef70 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:23.504649 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-979e9578-1069-4183-831f-70685de0ef70 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:23.505251 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-979e9578-1069-4183-831f-70685de0ef70 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:23.722713 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cef68b34-313a-488c-a8d6-3f7ceec80d3c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:23.747072 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cef68b34-313a-488c-a8d6-3f7ceec80d3c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:23.753867 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cef68b34-313a-488c-a8d6-3f7ceec80d3c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:23.757734 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cef68b34-313a-488c-a8d6-3f7ceec80d3c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 1.140821 Sep 01 17:39:23.759802 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 214/410] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:22 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:23.985789 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-979e9578-1069-4183-831f-70685de0ef70 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:24.005768 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-979e9578-1069-4183-831f-70685de0ef70 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1261 microversion: 2.1 time: 0.555048 Sep 01 17:39:24.025992 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 197/411] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:23 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1261 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:24.800553 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3c5948d8-a3d8-4084-bd5a-1762bb0d3793 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:24.801162 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3c5948d8-a3d8-4084-bd5a-1762bb0d3793 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:24.826165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3c5948d8-a3d8-4084-bd5a-1762bb0d3793 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:24.830046 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3c5948d8-a3d8-4084-bd5a-1762bb0d3793 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:24.831868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3c5948d8-a3d8-4084-bd5a-1762bb0d3793 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:24.837986 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3c5948d8-a3d8-4084-bd5a-1762bb0d3793 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:24.838489 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3c5948d8-a3d8-4084-bd5a-1762bb0d3793 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:24.839140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3c5948d8-a3d8-4084-bd5a-1762bb0d3793 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:25.037283 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bf9867a9-1da7-4a8f-82e6-2dbddd06cfc2 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:25.039890 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bf9867a9-1da7-4a8f-82e6-2dbddd06cfc2 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:25.060655 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bf9867a9-1da7-4a8f-82e6-2dbddd06cfc2 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:25.066668 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bf9867a9-1da7-4a8f-82e6-2dbddd06cfc2 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:25.071343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bf9867a9-1da7-4a8f-82e6-2dbddd06cfc2 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:25.072711 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bf9867a9-1da7-4a8f-82e6-2dbddd06cfc2 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:25.076261 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bf9867a9-1da7-4a8f-82e6-2dbddd06cfc2 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:25.079450 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bf9867a9-1da7-4a8f-82e6-2dbddd06cfc2 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:25.130274 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3c5948d8-a3d8-4084-bd5a-1762bb0d3793 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:25.144938 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3c5948d8-a3d8-4084-bd5a-1762bb0d3793 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:25.146784 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3c5948d8-a3d8-4084-bd5a-1762bb0d3793 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:25.150582 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3c5948d8-a3d8-4084-bd5a-1762bb0d3793 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.355839 Sep 01 17:39:25.166705 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 215/412] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:24 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:25.489303 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-77b1f9bb-36f3-4dbe-9a19-c913e2f49095 req-519bea31-3ec9-455d-98de-47ad5973b017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14547422-6c4f-4c71-8cf7-eaa09e5f52b0", "tag": "a58ebdf5-88c8-48f6-b574-774858b2603f"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:25.508422 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-77b1f9bb-36f3-4dbe-9a19-c913e2f49095 req-519bea31-3ec9-455d-98de-47ad5973b017 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:25.511955 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-77b1f9bb-36f3-4dbe-9a19-c913e2f49095 req-519bea31-3ec9-455d-98de-47ad5973b017 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:25.512817 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-77b1f9bb-36f3-4dbe-9a19-c913e2f49095 req-519bea31-3ec9-455d-98de-47ad5973b017 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:25.548457 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-77b1f9bb-36f3-4dbe-9a19-c913e2f49095 req-519bea31-3ec9-455d-98de-47ad5973b017 service nova] Creating event network-changed:a58ebdf5-88c8-48f6-b574-774858b2603f for instance 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 on hv-cinder-83976 Sep 01 17:39:25.573049 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-77b1f9bb-36f3-4dbe-9a19-c913e2f49095 req-519bea31-3ec9-455d-98de-47ad5973b017 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077147 Sep 01 17:39:25.575352 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 216/413] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:25.973687 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bf9867a9-1da7-4a8f-82e6-2dbddd06cfc2 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:25.982767 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=100 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:25.990981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bf9867a9-1da7-4a8f-82e6-2dbddd06cfc2 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1261 microversion: 2.1 time: 0.959658 Sep 01 17:39:26.006290 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 198/414] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:25 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1261 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:26.180839 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a2a16a36-a713-4537-a241-4cb0f0a65673 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:26.185415 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a2a16a36-a713-4537-a241-4cb0f0a65673 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:26.214814 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2a16a36-a713-4537-a241-4cb0f0a65673 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:26.215302 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2a16a36-a713-4537-a241-4cb0f0a65673 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:26.215731 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2a16a36-a713-4537-a241-4cb0f0a65673 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:26.216696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2a16a36-a713-4537-a241-4cb0f0a65673 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:26.216872 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2a16a36-a713-4537-a241-4cb0f0a65673 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:26.217321 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2a16a36-a713-4537-a241-4cb0f0a65673 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:27.070539 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-68896fd7-8067-4d11-b635-d2c5d6ea164e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:27.074654 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-68896fd7-8067-4d11-b635-d2c5d6ea164e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:27.104183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68896fd7-8067-4d11-b635-d2c5d6ea164e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:27.109900 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68896fd7-8067-4d11-b635-d2c5d6ea164e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:27.128515 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68896fd7-8067-4d11-b635-d2c5d6ea164e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:27.129006 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68896fd7-8067-4d11-b635-d2c5d6ea164e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:27.129708 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68896fd7-8067-4d11-b635-d2c5d6ea164e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:27.134032 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68896fd7-8067-4d11-b635-d2c5d6ea164e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:27.254867 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a2a16a36-a713-4537-a241-4cb0f0a65673 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:27.271174 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:27.301517 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a2a16a36-a713-4537-a241-4cb0f0a65673 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:27.308687 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a2a16a36-a713-4537-a241-4cb0f0a65673 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:27.320216 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a2a16a36-a713-4537-a241-4cb0f0a65673 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 1.134823 Sep 01 17:39:27.321477 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 217/415] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:26 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:27.505214 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-68896fd7-8067-4d11-b635-d2c5d6ea164e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:27.518326 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-68896fd7-8067-4d11-b635-d2c5d6ea164e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1261 microversion: 2.1 time: 0.481509 Sep 01 17:39:27.519379 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 199/416] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:27 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1261 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:28.362464 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4016135d-0a55-4296-b731-35b4e8e7997e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:28.362464 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4016135d-0a55-4296-b731-35b4e8e7997e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:28.368831 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=6 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:28.372555 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4016135d-0a55-4296-b731-35b4e8e7997e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:28.373299 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4016135d-0a55-4296-b731-35b4e8e7997e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:28.373953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4016135d-0a55-4296-b731-35b4e8e7997e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:28.375008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4016135d-0a55-4296-b731-35b4e8e7997e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:28.375622 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4016135d-0a55-4296-b731-35b4e8e7997e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:28.376213 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4016135d-0a55-4296-b731-35b4e8e7997e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:28.380258 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=100 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:28.543649 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4331020e-251f-463e-a176-f210805d955e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:28.544814 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4331020e-251f-463e-a176-f210805d955e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:28.569613 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:28.572307 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4331020e-251f-463e-a176-f210805d955e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:28.584040 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4331020e-251f-463e-a176-f210805d955e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:28.590922 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4331020e-251f-463e-a176-f210805d955e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:28.592846 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4331020e-251f-463e-a176-f210805d955e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:28.594143 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4331020e-251f-463e-a176-f210805d955e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:28.594773 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4331020e-251f-463e-a176-f210805d955e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:28.887360 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4016135d-0a55-4296-b731-35b4e8e7997e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:28.896085 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4016135d-0a55-4296-b731-35b4e8e7997e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:28.910125 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4016135d-0a55-4296-b731-35b4e8e7997e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:28.917555 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4016135d-0a55-4296-b731-35b4e8e7997e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.570583 Sep 01 17:39:28.918526 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 218/417] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:28 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:29.201373 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4331020e-251f-463e-a176-f210805d955e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:29.210581 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4331020e-251f-463e-a176-f210805d955e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1261 microversion: 2.1 time: 0.674080 Sep 01 17:39:29.211267 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 200/418] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:28 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1261 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:29.948395 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ff26b95e-6467-47f7-b979-362b59c38455 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:29.952189 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ff26b95e-6467-47f7-b979-362b59c38455 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:29.967394 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ff26b95e-6467-47f7-b979-362b59c38455 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:29.968166 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ff26b95e-6467-47f7-b979-362b59c38455 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:29.968850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ff26b95e-6467-47f7-b979-362b59c38455 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:29.969990 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ff26b95e-6467-47f7-b979-362b59c38455 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:29.970712 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ff26b95e-6467-47f7-b979-362b59c38455 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:29.974203 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ff26b95e-6467-47f7-b979-362b59c38455 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:30.236378 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c4096655-8961-40fb-acd0-075040ff3e76 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:30.237089 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c4096655-8961-40fb-acd0-075040ff3e76 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:30.264280 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c4096655-8961-40fb-acd0-075040ff3e76 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:30.264784 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c4096655-8961-40fb-acd0-075040ff3e76 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:30.265232 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c4096655-8961-40fb-acd0-075040ff3e76 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:30.281520 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c4096655-8961-40fb-acd0-075040ff3e76 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:30.281986 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c4096655-8961-40fb-acd0-075040ff3e76 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:30.282424 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c4096655-8961-40fb-acd0-075040ff3e76 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:30.306956 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ff26b95e-6467-47f7-b979-362b59c38455 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:30.316506 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ff26b95e-6467-47f7-b979-362b59c38455 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:30.317989 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ff26b95e-6467-47f7-b979-362b59c38455 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:30.319818 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ff26b95e-6467-47f7-b979-362b59c38455 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.376414 Sep 01 17:39:30.346141 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 219/419] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:29 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:30.684961 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c4096655-8961-40fb-acd0-075040ff3e76 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:30.694321 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c4096655-8961-40fb-acd0-075040ff3e76 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1261 microversion: 2.1 time: 0.463594 Sep 01 17:39:30.698619 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 201/420] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:30 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1261 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:31.350933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-dcaa0573-23bd-499e-9c96-a4d2f1909bf5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:31.352672 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-dcaa0573-23bd-499e-9c96-a4d2f1909bf5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:31.363356 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dcaa0573-23bd-499e-9c96-a4d2f1909bf5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:31.364252 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dcaa0573-23bd-499e-9c96-a4d2f1909bf5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:31.364927 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dcaa0573-23bd-499e-9c96-a4d2f1909bf5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:31.366560 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dcaa0573-23bd-499e-9c96-a4d2f1909bf5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:31.367462 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dcaa0573-23bd-499e-9c96-a4d2f1909bf5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:31.373115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dcaa0573-23bd-499e-9c96-a4d2f1909bf5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:31.574302 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-dcaa0573-23bd-499e-9c96-a4d2f1909bf5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:31.585843 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-dcaa0573-23bd-499e-9c96-a4d2f1909bf5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:31.587298 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-dcaa0573-23bd-499e-9c96-a4d2f1909bf5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:31.601538 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-dcaa0573-23bd-499e-9c96-a4d2f1909bf5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.255447 Sep 01 17:39:31.602345 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 220/421] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:31 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:31.733902 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-53bddc29-7191-4c74-b1ba-86c91f52f152 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:31.734732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-53bddc29-7191-4c74-b1ba-86c91f52f152 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:31.742487 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53bddc29-7191-4c74-b1ba-86c91f52f152 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:31.743365 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53bddc29-7191-4c74-b1ba-86c91f52f152 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:31.744052 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53bddc29-7191-4c74-b1ba-86c91f52f152 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:31.745039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53bddc29-7191-4c74-b1ba-86c91f52f152 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:31.745802 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53bddc29-7191-4c74-b1ba-86c91f52f152 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:31.746692 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53bddc29-7191-4c74-b1ba-86c91f52f152 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:31.985394 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-53bddc29-7191-4c74-b1ba-86c91f52f152 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:31.995343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-53bddc29-7191-4c74-b1ba-86c91f52f152 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1261 microversion: 2.1 time: 0.265867 Sep 01 17:39:32.002583 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 202/422] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:31 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1261 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:32.628215 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-92c577e1-e2c5-4af7-8645-09fe56c553d2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:32.629453 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-92c577e1-e2c5-4af7-8645-09fe56c553d2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:32.643116 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-92c577e1-e2c5-4af7-8645-09fe56c553d2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:32.644696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-92c577e1-e2c5-4af7-8645-09fe56c553d2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:32.645344 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-92c577e1-e2c5-4af7-8645-09fe56c553d2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:32.646276 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-92c577e1-e2c5-4af7-8645-09fe56c553d2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:32.646920 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-92c577e1-e2c5-4af7-8645-09fe56c553d2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:32.650623 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-92c577e1-e2c5-4af7-8645-09fe56c553d2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:33.025407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3f69476a-b8e1-40e1-837e-52b4b81d3899 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:33.032144 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3f69476a-b8e1-40e1-837e-52b4b81d3899 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:33.043303 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f69476a-b8e1-40e1-837e-52b4b81d3899 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:33.047438 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f69476a-b8e1-40e1-837e-52b4b81d3899 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:33.048139 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f69476a-b8e1-40e1-837e-52b4b81d3899 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:33.050788 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f69476a-b8e1-40e1-837e-52b4b81d3899 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:33.052226 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f69476a-b8e1-40e1-837e-52b4b81d3899 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:33.053545 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f69476a-b8e1-40e1-837e-52b4b81d3899 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:33.214022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-92c577e1-e2c5-4af7-8645-09fe56c553d2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:33.249066 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-92c577e1-e2c5-4af7-8645-09fe56c553d2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:33.250596 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-92c577e1-e2c5-4af7-8645-09fe56c553d2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:33.251817 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-92c577e1-e2c5-4af7-8645-09fe56c553d2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.627506 Sep 01 17:39:33.258008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 221/423] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:32 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:33.346038 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3f69476a-b8e1-40e1-837e-52b4b81d3899 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:33.356143 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-3f69476a-b8e1-40e1-837e-52b4b81d3899 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1261 microversion: 2.1 time: 0.335857 Sep 01 17:39:33.367503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 203/424] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:33 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1261 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:34.280348 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0426a313-ea74-4e8a-af04-5b7db89c622b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:34.281797 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0426a313-ea74-4e8a-af04-5b7db89c622b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:34.289452 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0426a313-ea74-4e8a-af04-5b7db89c622b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:34.290242 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0426a313-ea74-4e8a-af04-5b7db89c622b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:34.290862 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0426a313-ea74-4e8a-af04-5b7db89c622b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:34.291955 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0426a313-ea74-4e8a-af04-5b7db89c622b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:34.292608 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0426a313-ea74-4e8a-af04-5b7db89c622b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:34.293218 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0426a313-ea74-4e8a-af04-5b7db89c622b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:34.383281 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6dd4e4e2-9968-4c51-85b0-d286e5915d40 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:34.383922 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6dd4e4e2-9968-4c51-85b0-d286e5915d40 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:34.393440 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6dd4e4e2-9968-4c51-85b0-d286e5915d40 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:34.393965 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6dd4e4e2-9968-4c51-85b0-d286e5915d40 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:34.394383 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6dd4e4e2-9968-4c51-85b0-d286e5915d40 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:34.406787 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6dd4e4e2-9968-4c51-85b0-d286e5915d40 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:34.407292 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6dd4e4e2-9968-4c51-85b0-d286e5915d40 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:34.407733 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6dd4e4e2-9968-4c51-85b0-d286e5915d40 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:34.576146 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0426a313-ea74-4e8a-af04-5b7db89c622b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:34.589961 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0426a313-ea74-4e8a-af04-5b7db89c622b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:34.599558 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0426a313-ea74-4e8a-af04-5b7db89c622b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:34.604203 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0426a313-ea74-4e8a-af04-5b7db89c622b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.327678 Sep 01 17:39:34.608794 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 222/425] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:34 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:34.713069 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6dd4e4e2-9968-4c51-85b0-d286e5915d40 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:34.721252 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6dd4e4e2-9968-4c51-85b0-d286e5915d40 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1261 microversion: 2.1 time: 0.341863 Sep 01 17:39:34.721666 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 204/426] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:34 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1261 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:35.636434 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-156725ff-a9b5-4555-b813-abe743789315 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:35.637742 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-156725ff-a9b5-4555-b813-abe743789315 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:35.648231 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-156725ff-a9b5-4555-b813-abe743789315 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:35.650732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-156725ff-a9b5-4555-b813-abe743789315 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:35.651344 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-156725ff-a9b5-4555-b813-abe743789315 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:35.659312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-156725ff-a9b5-4555-b813-abe743789315 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:35.659972 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-156725ff-a9b5-4555-b813-abe743789315 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:35.660559 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-156725ff-a9b5-4555-b813-abe743789315 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:35.746729 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8ea802bc-ac36-4bca-b146-15960d658d33 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:35.748044 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8ea802bc-ac36-4bca-b146-15960d658d33 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:35.762113 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ea802bc-ac36-4bca-b146-15960d658d33 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:35.762862 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ea802bc-ac36-4bca-b146-15960d658d33 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:35.763454 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ea802bc-ac36-4bca-b146-15960d658d33 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:35.769748 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ea802bc-ac36-4bca-b146-15960d658d33 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:35.770439 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ea802bc-ac36-4bca-b146-15960d658d33 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:35.771023 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ea802bc-ac36-4bca-b146-15960d658d33 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:36.148568 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8ea802bc-ac36-4bca-b146-15960d658d33 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:36.161017 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8ea802bc-ac36-4bca-b146-15960d658d33 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1261 microversion: 2.1 time: 0.418323 Sep 01 17:39:36.165918 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 205/427] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:35 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1261 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:36.196374 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-156725ff-a9b5-4555-b813-abe743789315 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:36.208728 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-156725ff-a9b5-4555-b813-abe743789315 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:36.211038 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-156725ff-a9b5-4555-b813-abe743789315 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:36.212632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-156725ff-a9b5-4555-b813-abe743789315 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.580119 Sep 01 17:39:36.213812 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 223/428] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:35 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:36.797869 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-77551fe8-6c6d-4d03-8cdc-cb4beec9106c req-0e39e5bc-dddf-4e41-bc24-7dc1e8857047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14547422-6c4f-4c71-8cf7-eaa09e5f52b0", "name": "network-vif-plugged", "status": "completed", "tag": "a58ebdf5-88c8-48f6-b574-774858b2603f"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:36.811551 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-77551fe8-6c6d-4d03-8cdc-cb4beec9106c req-0e39e5bc-dddf-4e41-bc24-7dc1e8857047 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:36.814061 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-77551fe8-6c6d-4d03-8cdc-cb4beec9106c req-0e39e5bc-dddf-4e41-bc24-7dc1e8857047 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:36.814673 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-77551fe8-6c6d-4d03-8cdc-cb4beec9106c req-0e39e5bc-dddf-4e41-bc24-7dc1e8857047 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:36.829717 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-77551fe8-6c6d-4d03-8cdc-cb4beec9106c req-0e39e5bc-dddf-4e41-bc24-7dc1e8857047 service nova] Creating event network-vif-plugged:a58ebdf5-88c8-48f6-b574-774858b2603f for instance 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 on hv-cinder-83976 Sep 01 17:39:36.843089 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-77551fe8-6c6d-4d03-8cdc-cb4beec9106c req-0e39e5bc-dddf-4e41-bc24-7dc1e8857047 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053527 Sep 01 17:39:36.844003 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 206/429] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:39:37.191128 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2e562228-ed80-49f0-85fd-0e3ec2200dcb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:37.191672 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2e562228-ed80-49f0-85fd-0e3ec2200dcb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:37.208145 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e562228-ed80-49f0-85fd-0e3ec2200dcb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:37.208655 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e562228-ed80-49f0-85fd-0e3ec2200dcb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:37.209099 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e562228-ed80-49f0-85fd-0e3ec2200dcb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:37.210624 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e562228-ed80-49f0-85fd-0e3ec2200dcb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:37.211274 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e562228-ed80-49f0-85fd-0e3ec2200dcb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:37.211710 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e562228-ed80-49f0-85fd-0e3ec2200dcb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:37.237499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-86fb0fdf-c33a-4ea3-abcf-cf0f5445fee9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:37.238244 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-86fb0fdf-c33a-4ea3-abcf-cf0f5445fee9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:37.245025 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-86fb0fdf-c33a-4ea3-abcf-cf0f5445fee9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:37.245522 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-86fb0fdf-c33a-4ea3-abcf-cf0f5445fee9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:37.245985 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-86fb0fdf-c33a-4ea3-abcf-cf0f5445fee9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:37.262529 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-86fb0fdf-c33a-4ea3-abcf-cf0f5445fee9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:37.263195 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-86fb0fdf-c33a-4ea3-abcf-cf0f5445fee9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:37.268201 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-86fb0fdf-c33a-4ea3-abcf-cf0f5445fee9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:37.563156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-86fb0fdf-c33a-4ea3-abcf-cf0f5445fee9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:37.573467 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-86fb0fdf-c33a-4ea3-abcf-cf0f5445fee9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:37.580863 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-86fb0fdf-c33a-4ea3-abcf-cf0f5445fee9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:37.586345 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-86fb0fdf-c33a-4ea3-abcf-cf0f5445fee9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.353168 Sep 01 17:39:37.587165 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 207/430] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:37 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:37.658559 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2e562228-ed80-49f0-85fd-0e3ec2200dcb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:37.700515 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2e562228-ed80-49f0-85fd-0e3ec2200dcb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1261 microversion: 2.1 time: 0.513094 Sep 01 17:39:37.728341 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 224/431] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:37 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1261 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:38.616347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c5e3fc84-60c0-47af-a416-401dfc8afb4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:38.617864 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c5e3fc84-60c0-47af-a416-401dfc8afb4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:38.634637 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c5e3fc84-60c0-47af-a416-401dfc8afb4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:38.635464 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c5e3fc84-60c0-47af-a416-401dfc8afb4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:38.636196 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c5e3fc84-60c0-47af-a416-401dfc8afb4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:38.637119 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c5e3fc84-60c0-47af-a416-401dfc8afb4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:38.637789 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c5e3fc84-60c0-47af-a416-401dfc8afb4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:38.638432 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c5e3fc84-60c0-47af-a416-401dfc8afb4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:38.735816 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-418cba28-e3d8-497a-9526-6340a616102f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:38.737248 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-418cba28-e3d8-497a-9526-6340a616102f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:38.748899 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-418cba28-e3d8-497a-9526-6340a616102f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:38.754417 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-418cba28-e3d8-497a-9526-6340a616102f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:38.755170 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-418cba28-e3d8-497a-9526-6340a616102f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:38.756113 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-418cba28-e3d8-497a-9526-6340a616102f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:38.756765 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-418cba28-e3d8-497a-9526-6340a616102f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:38.763692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-418cba28-e3d8-497a-9526-6340a616102f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:39.021856 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-418cba28-e3d8-497a-9526-6340a616102f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:39.035350 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c5e3fc84-60c0-47af-a416-401dfc8afb4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:39.046397 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-418cba28-e3d8-497a-9526-6340a616102f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1261 microversion: 2.1 time: 0.314418 Sep 01 17:39:39.062800 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c5e3fc84-60c0-47af-a416-401dfc8afb4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:39.064406 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c5e3fc84-60c0-47af-a416-401dfc8afb4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:39.065643 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c5e3fc84-60c0-47af-a416-401dfc8afb4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.454947 Sep 01 17:39:39.066214 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 208/432] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:38 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:39.066568 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 225/433] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:38 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1261 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:40.070367 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-0d85ad66-6010-4a92-a439-420677c8a2af tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:40.075846 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-0d85ad66-6010-4a92-a439-420677c8a2af tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:40.095477 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7ff1994e-c87d-44e5-a226-4d7b03f0d9ce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:40.096213 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7ff1994e-c87d-44e5-a226-4d7b03f0d9ce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:40.105510 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0d85ad66-6010-4a92-a439-420677c8a2af tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:40.107857 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7ff1994e-c87d-44e5-a226-4d7b03f0d9ce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:40.108398 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0d85ad66-6010-4a92-a439-420677c8a2af tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:40.108915 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0d85ad66-6010-4a92-a439-420677c8a2af tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:40.114842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0d85ad66-6010-4a92-a439-420677c8a2af tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:40.115335 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0d85ad66-6010-4a92-a439-420677c8a2af tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:40.116330 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0d85ad66-6010-4a92-a439-420677c8a2af tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:40.123436 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7ff1994e-c87d-44e5-a226-4d7b03f0d9ce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:40.124121 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7ff1994e-c87d-44e5-a226-4d7b03f0d9ce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:40.125054 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7ff1994e-c87d-44e5-a226-4d7b03f0d9ce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:40.125811 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7ff1994e-c87d-44e5-a226-4d7b03f0d9ce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:40.127857 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7ff1994e-c87d-44e5-a226-4d7b03f0d9ce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:40.653521 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-0d85ad66-6010-4a92-a439-420677c8a2af tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:40.661926 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-0d85ad66-6010-4a92-a439-420677c8a2af tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1444 microversion: 2.1 time: 0.597173 Sep 01 17:39:40.688156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 209/434] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:40 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1444 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:40.702164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-fa77fb57-4278-4ac6-8557-7b3288a1884b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:40.711694 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-fa77fb57-4278-4ac6-8557-7b3288a1884b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:40.719755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7ff1994e-c87d-44e5-a226-4d7b03f0d9ce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:40.721379 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fa77fb57-4278-4ac6-8557-7b3288a1884b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:40.721907 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fa77fb57-4278-4ac6-8557-7b3288a1884b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:40.722348 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fa77fb57-4278-4ac6-8557-7b3288a1884b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:40.723066 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fa77fb57-4278-4ac6-8557-7b3288a1884b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:40.733451 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7ff1994e-c87d-44e5-a226-4d7b03f0d9ce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:40.733889 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fa77fb57-4278-4ac6-8557-7b3288a1884b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:40.734737 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fa77fb57-4278-4ac6-8557-7b3288a1884b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:40.736765 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7ff1994e-c87d-44e5-a226-4d7b03f0d9ce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:40.738448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7ff1994e-c87d-44e5-a226-4d7b03f0d9ce tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.650158 Sep 01 17:39:40.739435 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 226/435] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:40 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:40.964583 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-fa77fb57-4278-4ac6-8557-7b3288a1884b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:40.977370 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-fa77fb57-4278-4ac6-8557-7b3288a1884b tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1444 microversion: 2.1 time: 0.287848 Sep 01 17:39:40.978389 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 210/436] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:40 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1444 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:41.764205 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ed4e4080-1d3c-4523-b889-668a228daf54 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:41.764814 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ed4e4080-1d3c-4523-b889-668a228daf54 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:41.773129 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ed4e4080-1d3c-4523-b889-668a228daf54 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:41.773977 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ed4e4080-1d3c-4523-b889-668a228daf54 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:41.774607 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ed4e4080-1d3c-4523-b889-668a228daf54 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:41.775491 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ed4e4080-1d3c-4523-b889-668a228daf54 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:41.776095 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ed4e4080-1d3c-4523-b889-668a228daf54 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:41.776671 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ed4e4080-1d3c-4523-b889-668a228daf54 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:42.097879 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ed4e4080-1d3c-4523-b889-668a228daf54 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:42.111085 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ed4e4080-1d3c-4523-b889-668a228daf54 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:42.112542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ed4e4080-1d3c-4523-b889-668a228daf54 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:42.118834 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ed4e4080-1d3c-4523-b889-668a228daf54 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1744 microversion: 2.20 time: 0.353669 Sep 01 17:39:42.121136 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 227/437] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:41 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1744 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:39:43.152964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-838fca24-13b9-414d-91e9-c54c07f9166c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:43.154295 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-838fca24-13b9-414d-91e9-c54c07f9166c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:43.187642 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-838fca24-13b9-414d-91e9-c54c07f9166c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:43.188587 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-838fca24-13b9-414d-91e9-c54c07f9166c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:43.189025 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-838fca24-13b9-414d-91e9-c54c07f9166c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:43.189806 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-838fca24-13b9-414d-91e9-c54c07f9166c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:43.190264 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-838fca24-13b9-414d-91e9-c54c07f9166c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:43.190699 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-838fca24-13b9-414d-91e9-c54c07f9166c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:43.683780 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-838fca24-13b9-414d-91e9-c54c07f9166c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:43.694975 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-838fca24-13b9-414d-91e9-c54c07f9166c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:43.697064 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-838fca24-13b9-414d-91e9-c54c07f9166c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:43.698865 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-838fca24-13b9-414d-91e9-c54c07f9166c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1726 microversion: 2.20 time: 0.550007 Sep 01 17:39:43.699630 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 211/438] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:43 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1726 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:44.619273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-25bb1b2f-ad64-41dc-9833-8429e537cc39 req-f20764c3-e8c4-4894-8fff-7cb59ccb9021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc52ad3-09b3-4851-8a50-ad446bd1a75d", "name": "network-vif-unplugged", "status": "completed", "tag": "be99e7bf-5f6d-42df-82e3-b77a04fd7684"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:44.659412 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-25bb1b2f-ad64-41dc-9833-8429e537cc39 req-f20764c3-e8c4-4894-8fff-7cb59ccb9021 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:44.660113 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-25bb1b2f-ad64-41dc-9833-8429e537cc39 req-f20764c3-e8c4-4894-8fff-7cb59ccb9021 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:44.660705 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-25bb1b2f-ad64-41dc-9833-8429e537cc39 req-f20764c3-e8c4-4894-8fff-7cb59ccb9021 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:44.689771 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-25bb1b2f-ad64-41dc-9833-8429e537cc39 req-f20764c3-e8c4-4894-8fff-7cb59ccb9021 service nova] Creating event network-vif-unplugged:be99e7bf-5f6d-42df-82e3-b77a04fd7684 for instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d on hv-cinder-83976 Sep 01 17:39:44.702421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-25bb1b2f-ad64-41dc-9833-8429e537cc39 req-f20764c3-e8c4-4894-8fff-7cb59ccb9021 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088011 Sep 01 17:39:44.705567 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 228/439] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:39:44.726483 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cad63b6d-d47d-452f-bccf-35c53d39bd84 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:44.727738 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-cad63b6d-d47d-452f-bccf-35c53d39bd84 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:44.739379 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cad63b6d-d47d-452f-bccf-35c53d39bd84 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:44.740118 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cad63b6d-d47d-452f-bccf-35c53d39bd84 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:44.741008 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cad63b6d-d47d-452f-bccf-35c53d39bd84 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:44.742815 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cad63b6d-d47d-452f-bccf-35c53d39bd84 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:44.745358 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cad63b6d-d47d-452f-bccf-35c53d39bd84 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:44.747801 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cad63b6d-d47d-452f-bccf-35c53d39bd84 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:45.044319 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-cad63b6d-d47d-452f-bccf-35c53d39bd84 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:45.053809 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-cad63b6d-d47d-452f-bccf-35c53d39bd84 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:45.056177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-cad63b6d-d47d-452f-bccf-35c53d39bd84 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:45.057781 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-cad63b6d-d47d-452f-bccf-35c53d39bd84 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1726 microversion: 2.20 time: 0.336193 Sep 01 17:39:45.070057 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 212/440] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:44 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1726 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:45.246684 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-bb978da4-421d-46eb-8d4e-2d47566f3db6 req-4ab09aa0-d5c2-49e3-ad05-aa01f6165937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14547422-6c4f-4c71-8cf7-eaa09e5f52b0", "tag": "a58ebdf5-88c8-48f6-b574-774858b2603f"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:45.273379 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-bb978da4-421d-46eb-8d4e-2d47566f3db6 req-4ab09aa0-d5c2-49e3-ad05-aa01f6165937 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:45.278161 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-bb978da4-421d-46eb-8d4e-2d47566f3db6 req-4ab09aa0-d5c2-49e3-ad05-aa01f6165937 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:45.280556 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-bb978da4-421d-46eb-8d4e-2d47566f3db6 req-4ab09aa0-d5c2-49e3-ad05-aa01f6165937 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:45.297828 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-bb978da4-421d-46eb-8d4e-2d47566f3db6 req-4ab09aa0-d5c2-49e3-ad05-aa01f6165937 service nova] Creating event network-changed:a58ebdf5-88c8-48f6-b574-774858b2603f for instance 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 on hv-cinder-83976 Sep 01 17:39:45.310204 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-bb978da4-421d-46eb-8d4e-2d47566f3db6 req-4ab09aa0-d5c2-49e3-ad05-aa01f6165937 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067728 Sep 01 17:39:45.311083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 229/441] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:45.854310 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-aa73eafe-b333-4d64-9733-127899125358 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ec39c2a-50a6-4ffe-be1a-b13689b9baa4", "device": "/dev/sdb"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:45.859561 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-aa73eafe-b333-4d64-9733-127899125358 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:45.878508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa73eafe-b333-4d64-9733-127899125358 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:45.879012 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa73eafe-b333-4d64-9733-127899125358 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:45.879456 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa73eafe-b333-4d64-9733-127899125358 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:45.880166 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa73eafe-b333-4d64-9733-127899125358 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:45.880685 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa73eafe-b333-4d64-9733-127899125358 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:45.881127 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa73eafe-b333-4d64-9733-127899125358 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:46.083390 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b3cb3681-c6d0-4655-bda9-20e46feeaf1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:46.084708 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-b3cb3681-c6d0-4655-bda9-20e46feeaf1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:46.111092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3cb3681-c6d0-4655-bda9-20e46feeaf1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:46.112221 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3cb3681-c6d0-4655-bda9-20e46feeaf1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:46.114315 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3cb3681-c6d0-4655-bda9-20e46feeaf1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:46.115327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3cb3681-c6d0-4655-bda9-20e46feeaf1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:46.118221 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3cb3681-c6d0-4655-bda9-20e46feeaf1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:46.118862 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3cb3681-c6d0-4655-bda9-20e46feeaf1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:46.445427 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-aa73eafe-b333-4d64-9733-127899125358 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "POST /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.596417 Sep 01 17:39:46.447680 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 213/442] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:39:45 2022] POST /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d/os-volume_attachments => generated 194 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:46.472381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-61f72d4e-7180-4440-aef3-be5bdb356687 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:46.473281 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-61f72d4e-7180-4440-aef3-be5bdb356687 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:46.483392 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-61f72d4e-7180-4440-aef3-be5bdb356687 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:46.484534 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-61f72d4e-7180-4440-aef3-be5bdb356687 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:46.485423 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-61f72d4e-7180-4440-aef3-be5bdb356687 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:46.486395 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-61f72d4e-7180-4440-aef3-be5bdb356687 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:46.489332 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-61f72d4e-7180-4440-aef3-be5bdb356687 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:46.492068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-61f72d4e-7180-4440-aef3-be5bdb356687 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:46.586071 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-61f72d4e-7180-4440-aef3-be5bdb356687 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/ips" status: 200 len: 150 microversion: 2.1 time: 0.128592 Sep 01 17:39:46.587132 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 214/443] 10.222.0.100 () {58 vars in 1253 bytes} [Thu Sep 1 17:39:46 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/ips => generated 150 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:47.000257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b3cb3681-c6d0-4655-bda9-20e46feeaf1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:47.014017 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b3cb3681-c6d0-4655-bda9-20e46feeaf1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:47.017317 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b3cb3681-c6d0-4655-bda9-20e46feeaf1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:47.018887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-b3cb3681-c6d0-4655-bda9-20e46feeaf1a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1726 microversion: 2.20 time: 0.940186 Sep 01 17:39:47.035412 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 230/444] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:46 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1726 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:48.043551 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-26fb5df1-f0c1-4553-b075-b0976858fee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:48.044693 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-26fb5df1-f0c1-4553-b075-b0976858fee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:48.051434 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-26fb5df1-f0c1-4553-b075-b0976858fee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.051924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-26fb5df1-f0c1-4553-b075-b0976858fee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.052363 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-26fb5df1-f0c1-4553-b075-b0976858fee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:48.053826 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-26fb5df1-f0c1-4553-b075-b0976858fee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.054587 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-26fb5df1-f0c1-4553-b075-b0976858fee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.055021 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-26fb5df1-f0c1-4553-b075-b0976858fee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:48.060956 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:48.214860 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ae6ef7e1-d05d-489a-a0c1-9d39cde8ba5f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Action: 'create', calling method: .version_select at 0x7f354a6973a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1671587591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDXHebVGYas+mVf14WRgXwALE1qVp27YRRfqEazzwyns4WqAbnqQDFCpWnzMPSO2oxU5HuVmf6sdguYjTGIEdXDWCXMZ/ONhpZzcIsTqKj2ydbmLBmN4SyhjdxjvwRELQ=="}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:48.224232 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-26fb5df1-f0c1-4553-b075-b0976858fee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:48.233520 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-ae6ef7e1-d05d-489a-a0c1-9d39cde8ba5f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Getting quotas for project 829a41984faf4b68a3f4b1e2fd2ded27. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:39:48.235079 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-26fb5df1-f0c1-4553-b075-b0976858fee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:48.236994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-26fb5df1-f0c1-4553-b075-b0976858fee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:48.238385 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-26fb5df1-f0c1-4553-b075-b0976858fee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1669 microversion: 2.20 time: 0.198665 Sep 01 17:39:48.238539 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-ae6ef7e1-d05d-489a-a0c1-9d39cde8ba5f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Getting quotas for user c1bda5eb9abc4f6da200ea3f9500fbfa and project 829a41984faf4b68a3f4b1e2fd2ded27. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:39:48.239291 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 215/445] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:48 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1669 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:48.262548 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5c9bf383-bed1-4b1f-b161-a5f49f4f7113 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d94c0e66-e1c2-467a-ac17-36c6b423ddec"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:48.265702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5c9bf383-bed1-4b1f-b161-a5f49f4f7113 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:48.273325 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c9bf383-bed1-4b1f-b161-a5f49f4f7113 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.273960 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c9bf383-bed1-4b1f-b161-a5f49f4f7113 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.274405 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c9bf383-bed1-4b1f-b161-a5f49f4f7113 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:48.275125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c9bf383-bed1-4b1f-b161-a5f49f4f7113 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.275581 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c9bf383-bed1-4b1f-b161-a5f49f4f7113 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.276016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c9bf383-bed1-4b1f-b161-a5f49f4f7113 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:48.283434 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ae6ef7e1-d05d-489a-a0c1-9d39cde8ba5f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.075093 Sep 01 17:39:48.284071 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 231/446] 10.222.0.100 () {60 vars in 1164 bytes} [Thu Sep 1 17:39:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:39:48.289934 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-9b063116-9a8f-4377-9c2c-aad240e69de9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc8b29da-ae5b-4b92-ac27-b28723b25434"}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:48.292267 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-9b063116-9a8f-4377-9c2c-aad240e69de9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:48.299294 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9b063116-9a8f-4377-9c2c-aad240e69de9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.299788 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9b063116-9a8f-4377-9c2c-aad240e69de9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.300241 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9b063116-9a8f-4377-9c2c-aad240e69de9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:48.300918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9b063116-9a8f-4377-9c2c-aad240e69de9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.301368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9b063116-9a8f-4377-9c2c-aad240e69de9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.301827 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9b063116-9a8f-4377-9c2c-aad240e69de9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:48.607447 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-9b063116-9a8f-4377-9c2c-aad240e69de9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "POST /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321684 Sep 01 17:39:48.608485 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 232/447] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:39:48 2022] POST /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:48.616074 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-521485524", "imageRef": "3731680a-1115-4d0d-9b42-9f492e6782be", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1671587591", "networks": [{"uuid": "c3a62555-79df-46af-8b72-edcbf7b35d15"}]}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:48.664587 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5c9bf383-bed1-4b1f-b161-a5f49f4f7113 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "POST /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.405777 Sep 01 17:39:48.666841 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 216/448] 10.222.0.100 () {62 vars in 1369 bytes} [Thu Sep 1 17:39:48 2022] POST /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments => generated 188 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:39:48.703923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.network.neutron [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] validate_networks() for [('c3a62555-79df-46af-8b72-edcbf7b35d15', None, None, None, None, None)] {{(pid=127233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:39:48.833301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6840a218-825f-4a3f-bc04-5f084b976154 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:48.834116 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6840a218-825f-4a3f-bc04-5f084b976154 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:48.840730 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6840a218-825f-4a3f-bc04-5f084b976154 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.841214 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6840a218-825f-4a3f-bc04-5f084b976154 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.841682 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6840a218-825f-4a3f-bc04-5f084b976154 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:48.842388 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6840a218-825f-4a3f-bc04-5f084b976154 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.843170 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6840a218-825f-4a3f-bc04-5f084b976154 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.843315 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6840a218-825f-4a3f-bc04-5f084b976154 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:48.892330 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6840a218-825f-4a3f-bc04-5f084b976154 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127232) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 17:39:48.966476 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6840a218-825f-4a3f-bc04-5f084b976154 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "POST /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/action" status: 202 len: 0 microversion: 2.20 time: 0.136996 Sep 01 17:39:48.967331 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 217/449] 10.222.0.100 () {62 vars in 1324 bytes} [Thu Sep 1 17:39:48 2022] POST /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 17:39:48.975915 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-dbffe36a-ed71-49fd-bf46-0ee403b9d5b7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:48.976530 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-dbffe36a-ed71-49fd-bf46-0ee403b9d5b7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:48.982732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dbffe36a-ed71-49fd-bf46-0ee403b9d5b7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.983422 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dbffe36a-ed71-49fd-bf46-0ee403b9d5b7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.983868 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dbffe36a-ed71-49fd-bf46-0ee403b9d5b7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:48.984694 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dbffe36a-ed71-49fd-bf46-0ee403b9d5b7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.985119 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dbffe36a-ed71-49fd-bf46-0ee403b9d5b7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.986721 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dbffe36a-ed71-49fd-bf46-0ee403b9d5b7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:49.220620 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-dbffe36a-ed71-49fd-bf46-0ee403b9d5b7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:49.222425 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Flavor limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:39:49.222856 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Image limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:39:49.223321 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Flavor pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:39:49.223732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Image pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:39:49.224147 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:39:49.232834 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-dbffe36a-ed71-49fd-bf46-0ee403b9d5b7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:49.234418 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:49.235058 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-dbffe36a-ed71-49fd-bf46-0ee403b9d5b7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:49.235299 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:49.235881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:49.236301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-dbffe36a-ed71-49fd-bf46-0ee403b9d5b7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1755 microversion: 2.20 time: 0.264966 Sep 01 17:39:49.236869 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 218/450] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:48 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1755 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:39:49.237372 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:49.237871 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:49.238299 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:49.257525 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Getting quotas for project 829a41984faf4b68a3f4b1e2fd2ded27. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:39:49.262070 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Getting quotas for user c1bda5eb9abc4f6da200ea3f9500fbfa and project 829a41984faf4b68a3f4b1e2fd2ded27. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:39:49.274701 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Going to run 1 instances... {{(pid=127233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:39:49.277084 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3731680a-1115-4d0d-9b42-9f492e6782be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:39:49.330627 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-60893e87-bfe2-4aa5-abf5-cb1f25c64aee tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.720602 Sep 01 17:39:49.331502 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 233/451] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:39:48 2022] POST /compute/v2.1/servers => generated 382 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:39:49.343687 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f18f5120-77e9-43a2-b4fa-b472124a9639 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:49.344301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f18f5120-77e9-43a2-b4fa-b472124a9639 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:49.405906 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f18f5120-77e9-43a2-b4fa-b472124a9639 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:49.414838 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f18f5120-77e9-43a2-b4fa-b472124a9639 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1262 microversion: 2.1 time: 0.075252 Sep 01 17:39:49.415414 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 219/452] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:49 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1262 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:50.262786 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1582f40a-edcb-4765-aeb9-73df374531e5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:50.263399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-1582f40a-edcb-4765-aeb9-73df374531e5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:50.274542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1582f40a-edcb-4765-aeb9-73df374531e5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:50.275222 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1582f40a-edcb-4765-aeb9-73df374531e5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:50.275662 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1582f40a-edcb-4765-aeb9-73df374531e5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:50.276371 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1582f40a-edcb-4765-aeb9-73df374531e5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:50.276827 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1582f40a-edcb-4765-aeb9-73df374531e5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:50.277245 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1582f40a-edcb-4765-aeb9-73df374531e5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:50.411934 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-1582f40a-edcb-4765-aeb9-73df374531e5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:50.421604 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-1582f40a-edcb-4765-aeb9-73df374531e5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:50.423070 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-1582f40a-edcb-4765-aeb9-73df374531e5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:50.424259 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1582f40a-edcb-4765-aeb9-73df374531e5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.165691 Sep 01 17:39:50.424823 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 234/453] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:50 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:39:50.435472 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bbc00d60-3afc-411f-9e0e-78a7634b78a4 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:50.436216 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bbc00d60-3afc-411f-9e0e-78a7634b78a4 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:50.446528 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbc00d60-3afc-411f-9e0e-78a7634b78a4 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:50.447006 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbc00d60-3afc-411f-9e0e-78a7634b78a4 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:50.447456 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbc00d60-3afc-411f-9e0e-78a7634b78a4 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:50.448143 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbc00d60-3afc-411f-9e0e-78a7634b78a4 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:50.448616 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbc00d60-3afc-411f-9e0e-78a7634b78a4 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:50.449035 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbc00d60-3afc-411f-9e0e-78a7634b78a4 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:50.522646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bbc00d60-3afc-411f-9e0e-78a7634b78a4 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:50.530803 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bbc00d60-3afc-411f-9e0e-78a7634b78a4 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1314 microversion: 2.1 time: 0.099206 Sep 01 17:39:50.531396 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 220/454] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:50 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1314 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:51.451353 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e68b7c40-c1f6-4179-92ae-48d7f1ad2902 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:51.452273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e68b7c40-c1f6-4179-92ae-48d7f1ad2902 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:51.473368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e68b7c40-c1f6-4179-92ae-48d7f1ad2902 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:51.475481 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e68b7c40-c1f6-4179-92ae-48d7f1ad2902 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:51.476752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e68b7c40-c1f6-4179-92ae-48d7f1ad2902 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:51.481160 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e68b7c40-c1f6-4179-92ae-48d7f1ad2902 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:51.481986 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e68b7c40-c1f6-4179-92ae-48d7f1ad2902 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:51.482638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e68b7c40-c1f6-4179-92ae-48d7f1ad2902 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:51.563573 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-df357614-8388-46f0-8c66-bf6f4c4d880e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:51.564270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-df357614-8388-46f0-8c66-bf6f4c4d880e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:51.573466 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-df357614-8388-46f0-8c66-bf6f4c4d880e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:51.573985 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-df357614-8388-46f0-8c66-bf6f4c4d880e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:51.574419 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-df357614-8388-46f0-8c66-bf6f4c4d880e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:51.575119 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-df357614-8388-46f0-8c66-bf6f4c4d880e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:51.575567 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-df357614-8388-46f0-8c66-bf6f4c4d880e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:51.575992 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-df357614-8388-46f0-8c66-bf6f4c4d880e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:51.863670 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e68b7c40-c1f6-4179-92ae-48d7f1ad2902 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:51.905769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e68b7c40-c1f6-4179-92ae-48d7f1ad2902 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:51.907986 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e68b7c40-c1f6-4179-92ae-48d7f1ad2902 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:51.911900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e68b7c40-c1f6-4179-92ae-48d7f1ad2902 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.466658 Sep 01 17:39:51.913628 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 235/455] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:51 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:52.005142 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-df357614-8388-46f0-8c66-bf6f4c4d880e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:52.043285 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-df357614-8388-46f0-8c66-bf6f4c4d880e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.479699 Sep 01 17:39:52.043952 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 221/456] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:51 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:39:52.728524 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-f886a5c5-ac45-4f51-8229-8afefbb0d81f req-8292bd4c-8538-460d-aa52-52582c6d8496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c4d577-d281-42b7-b448-d38b39a7ee39", "tag": "43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:52.739555 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-f886a5c5-ac45-4f51-8229-8afefbb0d81f req-8292bd4c-8538-460d-aa52-52582c6d8496 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:52.745770 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-f886a5c5-ac45-4f51-8229-8afefbb0d81f req-8292bd4c-8538-460d-aa52-52582c6d8496 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:52.746595 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-f886a5c5-ac45-4f51-8229-8afefbb0d81f req-8292bd4c-8538-460d-aa52-52582c6d8496 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:52.759605 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-f886a5c5-ac45-4f51-8229-8afefbb0d81f req-8292bd4c-8538-460d-aa52-52582c6d8496 service nova] Creating event network-changed:43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c for instance 14c4d577-d281-42b7-b448-d38b39a7ee39 on hv-cinder-83976 Sep 01 17:39:52.765458 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-f886a5c5-ac45-4f51-8229-8afefbb0d81f req-8292bd4c-8538-460d-aa52-52582c6d8496 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040683 Sep 01 17:39:52.766158 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 236/457] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:52.937232 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-50b965fb-b006-4ed0-86ed-2dd8b636bc21 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:52.938072 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-50b965fb-b006-4ed0-86ed-2dd8b636bc21 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:52.947489 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-50b965fb-b006-4ed0-86ed-2dd8b636bc21 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:52.948719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-50b965fb-b006-4ed0-86ed-2dd8b636bc21 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:52.949156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-50b965fb-b006-4ed0-86ed-2dd8b636bc21 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:52.950037 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-50b965fb-b006-4ed0-86ed-2dd8b636bc21 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:52.950514 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-50b965fb-b006-4ed0-86ed-2dd8b636bc21 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:52.951085 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-50b965fb-b006-4ed0-86ed-2dd8b636bc21 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:53.070209 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-32c758a6-348d-4a7f-b094-c0f84c9bb307 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:53.070909 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-32c758a6-348d-4a7f-b094-c0f84c9bb307 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:53.073116 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:53.081053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-32c758a6-348d-4a7f-b094-c0f84c9bb307 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:53.081993 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-32c758a6-348d-4a7f-b094-c0f84c9bb307 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:53.082615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-32c758a6-348d-4a7f-b094-c0f84c9bb307 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:53.083928 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-32c758a6-348d-4a7f-b094-c0f84c9bb307 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:53.084915 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-32c758a6-348d-4a7f-b094-c0f84c9bb307 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:53.085552 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-32c758a6-348d-4a7f-b094-c0f84c9bb307 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:53.091410 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:53.194475 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-50b965fb-b006-4ed0-86ed-2dd8b636bc21 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:53.205825 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-50b965fb-b006-4ed0-86ed-2dd8b636bc21 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:53.207582 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-50b965fb-b006-4ed0-86ed-2dd8b636bc21 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:53.210093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-50b965fb-b006-4ed0-86ed-2dd8b636bc21 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.276496 Sep 01 17:39:53.211020 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 222/458] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:52 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:53.267666 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-32c758a6-348d-4a7f-b094-c0f84c9bb307 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:53.276324 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-32c758a6-348d-4a7f-b094-c0f84c9bb307 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.210509 Sep 01 17:39:53.277159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 237/459] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:53 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:54.238635 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-be37e927-46f7-401b-9473-d7aa1f833000 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:54.239365 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-be37e927-46f7-401b-9473-d7aa1f833000 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:54.242335 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:54.247707 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-be37e927-46f7-401b-9473-d7aa1f833000 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:54.248200 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-be37e927-46f7-401b-9473-d7aa1f833000 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:54.248636 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-be37e927-46f7-401b-9473-d7aa1f833000 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:54.249340 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-be37e927-46f7-401b-9473-d7aa1f833000 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:54.249817 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-be37e927-46f7-401b-9473-d7aa1f833000 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:54.250244 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-be37e927-46f7-401b-9473-d7aa1f833000 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:54.299092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d0487f07-b9e9-4bd0-877a-b91583814df9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:54.299701 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d0487f07-b9e9-4bd0-877a-b91583814df9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:54.309617 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d0487f07-b9e9-4bd0-877a-b91583814df9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:54.310364 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d0487f07-b9e9-4bd0-877a-b91583814df9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:54.311068 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d0487f07-b9e9-4bd0-877a-b91583814df9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:54.311964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d0487f07-b9e9-4bd0-877a-b91583814df9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:54.312604 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d0487f07-b9e9-4bd0-877a-b91583814df9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:54.313191 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d0487f07-b9e9-4bd0-877a-b91583814df9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:54.438255 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-be37e927-46f7-401b-9473-d7aa1f833000 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:54.448807 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-be37e927-46f7-401b-9473-d7aa1f833000 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:54.450290 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-be37e927-46f7-401b-9473-d7aa1f833000 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:54.452185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-be37e927-46f7-401b-9473-d7aa1f833000 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.219440 Sep 01 17:39:54.465906 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 223/460] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:54 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:54.491565 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d0487f07-b9e9-4bd0-877a-b91583814df9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:54.499804 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d0487f07-b9e9-4bd0-877a-b91583814df9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.205012 Sep 01 17:39:54.500388 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 238/461] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:54 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:39:55.481376 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-662725ae-a4ec-4a25-b76d-608d2229ebc3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:55.483051 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-662725ae-a4ec-4a25-b76d-608d2229ebc3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:55.489854 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-662725ae-a4ec-4a25-b76d-608d2229ebc3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:55.490552 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-662725ae-a4ec-4a25-b76d-608d2229ebc3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:55.491062 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-662725ae-a4ec-4a25-b76d-608d2229ebc3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:55.491969 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-662725ae-a4ec-4a25-b76d-608d2229ebc3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:55.492425 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-662725ae-a4ec-4a25-b76d-608d2229ebc3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:55.492854 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-662725ae-a4ec-4a25-b76d-608d2229ebc3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:55.523686 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-30950967-d7f0-4ddf-8868-70580602a1c2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:55.524479 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-30950967-d7f0-4ddf-8868-70580602a1c2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:55.530680 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-30950967-d7f0-4ddf-8868-70580602a1c2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:55.531169 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-30950967-d7f0-4ddf-8868-70580602a1c2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:55.531805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-30950967-d7f0-4ddf-8868-70580602a1c2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:55.541866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-30950967-d7f0-4ddf-8868-70580602a1c2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:55.542489 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-30950967-d7f0-4ddf-8868-70580602a1c2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:55.542929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-30950967-d7f0-4ddf-8868-70580602a1c2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:55.767282 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-662725ae-a4ec-4a25-b76d-608d2229ebc3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:55.779992 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-662725ae-a4ec-4a25-b76d-608d2229ebc3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:55.781866 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-662725ae-a4ec-4a25-b76d-608d2229ebc3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:55.783276 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-662725ae-a4ec-4a25-b76d-608d2229ebc3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.309812 Sep 01 17:39:55.784038 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 224/462] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:55 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:55.806797 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-30950967-d7f0-4ddf-8868-70580602a1c2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:55.822523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-30950967-d7f0-4ddf-8868-70580602a1c2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.303503 Sep 01 17:39:55.823590 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 239/463] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:55 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:56.813046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ac13b83d-0ce4-4758-9936-7f34e6f103ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:56.813046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ac13b83d-0ce4-4758-9936-7f34e6f103ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:56.819103 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ac13b83d-0ce4-4758-9936-7f34e6f103ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:56.819657 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ac13b83d-0ce4-4758-9936-7f34e6f103ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:56.820094 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ac13b83d-0ce4-4758-9936-7f34e6f103ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:56.820807 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ac13b83d-0ce4-4758-9936-7f34e6f103ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:56.821262 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ac13b83d-0ce4-4758-9936-7f34e6f103ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:56.822222 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ac13b83d-0ce4-4758-9936-7f34e6f103ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:56.853130 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0e7b782b-21cb-48b6-9aa0-6013d3d8800b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:56.855288 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0e7b782b-21cb-48b6-9aa0-6013d3d8800b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:56.871425 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e7b782b-21cb-48b6-9aa0-6013d3d8800b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:56.873300 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e7b782b-21cb-48b6-9aa0-6013d3d8800b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:56.874586 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e7b782b-21cb-48b6-9aa0-6013d3d8800b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:56.876489 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e7b782b-21cb-48b6-9aa0-6013d3d8800b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:56.877638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e7b782b-21cb-48b6-9aa0-6013d3d8800b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:56.878647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e7b782b-21cb-48b6-9aa0-6013d3d8800b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:57.123606 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ac13b83d-0ce4-4758-9936-7f34e6f103ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:57.150824 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ac13b83d-0ce4-4758-9936-7f34e6f103ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:57.155911 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ac13b83d-0ce4-4758-9936-7f34e6f103ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:57.157180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ac13b83d-0ce4-4758-9936-7f34e6f103ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.351340 Sep 01 17:39:57.174283 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 225/464] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:56 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:39:57.185815 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0e7b782b-21cb-48b6-9aa0-6013d3d8800b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:57.201411 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0e7b782b-21cb-48b6-9aa0-6013d3d8800b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.355619 Sep 01 17:39:57.204685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 240/465] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:56 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:58.189322 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-19bffa30-c7e0-441d-925e-fa54477e0004 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:58.190983 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-19bffa30-c7e0-441d-925e-fa54477e0004 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:58.197806 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-19bffa30-c7e0-441d-925e-fa54477e0004 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:58.198288 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-19bffa30-c7e0-441d-925e-fa54477e0004 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:58.198728 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-19bffa30-c7e0-441d-925e-fa54477e0004 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:58.199448 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-19bffa30-c7e0-441d-925e-fa54477e0004 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:58.199901 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-19bffa30-c7e0-441d-925e-fa54477e0004 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:58.200331 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-19bffa30-c7e0-441d-925e-fa54477e0004 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:58.239280 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-350fe25f-abb6-4003-84f5-5d724c099923 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:58.240953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-350fe25f-abb6-4003-84f5-5d724c099923 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:58.248457 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-350fe25f-abb6-4003-84f5-5d724c099923 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:58.249317 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-350fe25f-abb6-4003-84f5-5d724c099923 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:58.250025 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-350fe25f-abb6-4003-84f5-5d724c099923 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:58.251013 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-350fe25f-abb6-4003-84f5-5d724c099923 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:58.251704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-350fe25f-abb6-4003-84f5-5d724c099923 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:58.252450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-350fe25f-abb6-4003-84f5-5d724c099923 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:58.475072 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-19bffa30-c7e0-441d-925e-fa54477e0004 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:58.487902 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-350fe25f-abb6-4003-84f5-5d724c099923 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:58.492906 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-19bffa30-c7e0-441d-925e-fa54477e0004 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:58.495526 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-19bffa30-c7e0-441d-925e-fa54477e0004 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:58.496472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-350fe25f-abb6-4003-84f5-5d724c099923 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.260918 Sep 01 17:39:58.497068 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 241/466] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:58 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:39:58.499452 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-19bffa30-c7e0-441d-925e-fa54477e0004 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.313653 Sep 01 17:39:58.500117 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 226/467] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:58 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:39:59.518167 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8687d4b9-5deb-4479-b2b9-3c63723187bd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:59.519607 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8687d4b9-5deb-4479-b2b9-3c63723187bd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:59.525480 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-85688dc2-6572-4472-a3cd-6c502cedf4f3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:59.526360 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-85688dc2-6572-4472-a3cd-6c502cedf4f3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:59.533132 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:59.537364 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=10 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:59.538685 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:59.540875 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85688dc2-6572-4472-a3cd-6c502cedf4f3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:59.541896 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85688dc2-6572-4472-a3cd-6c502cedf4f3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:59.542590 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85688dc2-6572-4472-a3cd-6c502cedf4f3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:59.543569 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85688dc2-6572-4472-a3cd-6c502cedf4f3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:59.544345 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85688dc2-6572-4472-a3cd-6c502cedf4f3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:59.545007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85688dc2-6572-4472-a3cd-6c502cedf4f3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:59.556948 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8687d4b9-5deb-4479-b2b9-3c63723187bd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:59.557739 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8687d4b9-5deb-4479-b2b9-3c63723187bd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:59.558352 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8687d4b9-5deb-4479-b2b9-3c63723187bd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:59.559517 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8687d4b9-5deb-4479-b2b9-3c63723187bd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:59.562507 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8687d4b9-5deb-4479-b2b9-3c63723187bd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:59.563048 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8687d4b9-5deb-4479-b2b9-3c63723187bd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:00.069901 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-85688dc2-6572-4472-a3cd-6c502cedf4f3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:00.086102 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-85688dc2-6572-4472-a3cd-6c502cedf4f3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:00.088553 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-85688dc2-6572-4472-a3cd-6c502cedf4f3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:00.089937 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-85688dc2-6572-4472-a3cd-6c502cedf4f3 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.568189 Sep 01 17:40:00.090515 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 227/468] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:39:59 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:00.100311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8687d4b9-5deb-4479-b2b9-3c63723187bd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:00.109219 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8687d4b9-5deb-4479-b2b9-3c63723187bd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.595534 Sep 01 17:40:00.109833 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 242/469] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:59 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:01.119413 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3d7d9d4e-7418-4371-a52f-50fecfe859fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:01.120441 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3d7d9d4e-7418-4371-a52f-50fecfe859fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:01.127218 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3d7d9d4e-7418-4371-a52f-50fecfe859fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:01.127718 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3d7d9d4e-7418-4371-a52f-50fecfe859fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:01.128157 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3d7d9d4e-7418-4371-a52f-50fecfe859fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:01.128853 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3d7d9d4e-7418-4371-a52f-50fecfe859fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:01.129305 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3d7d9d4e-7418-4371-a52f-50fecfe859fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:01.129973 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3d7d9d4e-7418-4371-a52f-50fecfe859fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:01.131708 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-dc86cc95-f9dc-4df2-a0d3-6ed0a980304b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:01.132704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-dc86cc95-f9dc-4df2-a0d3-6ed0a980304b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:01.140744 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dc86cc95-f9dc-4df2-a0d3-6ed0a980304b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:01.141234 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dc86cc95-f9dc-4df2-a0d3-6ed0a980304b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:01.141691 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dc86cc95-f9dc-4df2-a0d3-6ed0a980304b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:01.142412 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dc86cc95-f9dc-4df2-a0d3-6ed0a980304b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:01.142861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dc86cc95-f9dc-4df2-a0d3-6ed0a980304b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:01.143282 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dc86cc95-f9dc-4df2-a0d3-6ed0a980304b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:01.350139 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-dc86cc95-f9dc-4df2-a0d3-6ed0a980304b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:01.367458 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3d7d9d4e-7418-4371-a52f-50fecfe859fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:01.384896 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-dc86cc95-f9dc-4df2-a0d3-6ed0a980304b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.252665 Sep 01 17:40:01.386864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 243/470] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:01 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:01.395041 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3d7d9d4e-7418-4371-a52f-50fecfe859fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:01.396755 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3d7d9d4e-7418-4371-a52f-50fecfe859fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:01.398167 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-3d7d9d4e-7418-4371-a52f-50fecfe859fa tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.283037 Sep 01 17:40:01.398925 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 228/471] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:01 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:02.419726 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-533c477d-4af7-4df6-b7dd-2fbdc9ae0e63 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:02.420387 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-533c477d-4af7-4df6-b7dd-2fbdc9ae0e63 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:02.428301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-7f16495d-edcf-4caf-ac7c-d5251658dbea tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:02.428902 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-533c477d-4af7-4df6-b7dd-2fbdc9ae0e63 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:02.429399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-533c477d-4af7-4df6-b7dd-2fbdc9ae0e63 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:02.429622 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-7f16495d-edcf-4caf-ac7c-d5251658dbea tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:02.429938 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-533c477d-4af7-4df6-b7dd-2fbdc9ae0e63 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:02.431805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-533c477d-4af7-4df6-b7dd-2fbdc9ae0e63 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:02.433285 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-533c477d-4af7-4df6-b7dd-2fbdc9ae0e63 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:02.436043 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-533c477d-4af7-4df6-b7dd-2fbdc9ae0e63 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:02.437938 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7f16495d-edcf-4caf-ac7c-d5251658dbea tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:02.438433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7f16495d-edcf-4caf-ac7c-d5251658dbea tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:02.438875 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7f16495d-edcf-4caf-ac7c-d5251658dbea tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:02.439588 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7f16495d-edcf-4caf-ac7c-d5251658dbea tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:02.440041 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7f16495d-edcf-4caf-ac7c-d5251658dbea tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:02.440469 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7f16495d-edcf-4caf-ac7c-d5251658dbea tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:02.446266 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:02.694354 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-533c477d-4af7-4df6-b7dd-2fbdc9ae0e63 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:02.701532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7f16495d-edcf-4caf-ac7c-d5251658dbea tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:02.709345 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-533c477d-4af7-4df6-b7dd-2fbdc9ae0e63 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.292618 Sep 01 17:40:02.710725 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 244/472] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:02 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:02.721855 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7f16495d-edcf-4caf-ac7c-d5251658dbea tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:02.721855 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7f16495d-edcf-4caf-ac7c-d5251658dbea tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:02.721855 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-7f16495d-edcf-4caf-ac7c-d5251658dbea tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.293096 Sep 01 17:40:02.722502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 229/473] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:02 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:03.742076 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-329c4910-5a9d-4309-bf65-85140cc8bac2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:03.742708 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-329c4910-5a9d-4309-bf65-85140cc8bac2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:03.751794 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-329c4910-5a9d-4309-bf65-85140cc8bac2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:03.752320 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-329c4910-5a9d-4309-bf65-85140cc8bac2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:03.752502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bae091a4-94b0-4e75-8aec-84ca0cf27e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:03.752984 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-329c4910-5a9d-4309-bf65-85140cc8bac2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:03.753461 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-329c4910-5a9d-4309-bf65-85140cc8bac2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:03.753669 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bae091a4-94b0-4e75-8aec-84ca0cf27e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:03.753944 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-329c4910-5a9d-4309-bf65-85140cc8bac2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:03.754371 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-329c4910-5a9d-4309-bf65-85140cc8bac2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:03.766373 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bae091a4-94b0-4e75-8aec-84ca0cf27e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:03.767101 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bae091a4-94b0-4e75-8aec-84ca0cf27e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:03.767680 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bae091a4-94b0-4e75-8aec-84ca0cf27e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:03.768461 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bae091a4-94b0-4e75-8aec-84ca0cf27e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:03.769287 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bae091a4-94b0-4e75-8aec-84ca0cf27e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:03.770089 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bae091a4-94b0-4e75-8aec-84ca0cf27e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:03.963507 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-329c4910-5a9d-4309-bf65-85140cc8bac2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:03.971661 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-329c4910-5a9d-4309-bf65-85140cc8bac2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.233605 Sep 01 17:40:03.972442 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 245/474] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:03 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:03.992443 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bae091a4-94b0-4e75-8aec-84ca0cf27e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:04.001667 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bae091a4-94b0-4e75-8aec-84ca0cf27e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:04.003226 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bae091a4-94b0-4e75-8aec-84ca0cf27e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:04.004406 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bae091a4-94b0-4e75-8aec-84ca0cf27e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.267367 Sep 01 17:40:04.004972 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 230/475] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:03 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:05.002348 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0fb3ae5a-789d-4e3e-8399-2dbba99ca077 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:05.002873 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0fb3ae5a-789d-4e3e-8399-2dbba99ca077 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:05.009926 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0fb3ae5a-789d-4e3e-8399-2dbba99ca077 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:05.010411 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0fb3ae5a-789d-4e3e-8399-2dbba99ca077 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:05.010846 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0fb3ae5a-789d-4e3e-8399-2dbba99ca077 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:05.011543 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0fb3ae5a-789d-4e3e-8399-2dbba99ca077 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:05.011996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0fb3ae5a-789d-4e3e-8399-2dbba99ca077 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:05.012422 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0fb3ae5a-789d-4e3e-8399-2dbba99ca077 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:05.028862 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d39c73a4-2ed4-447c-a1af-e3a0d6c37e0a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:05.029558 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d39c73a4-2ed4-447c-a1af-e3a0d6c37e0a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:05.035968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d39c73a4-2ed4-447c-a1af-e3a0d6c37e0a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:05.036448 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d39c73a4-2ed4-447c-a1af-e3a0d6c37e0a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:05.040839 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d39c73a4-2ed4-447c-a1af-e3a0d6c37e0a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:05.041679 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d39c73a4-2ed4-447c-a1af-e3a0d6c37e0a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:05.042161 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d39c73a4-2ed4-447c-a1af-e3a0d6c37e0a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:05.042594 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d39c73a4-2ed4-447c-a1af-e3a0d6c37e0a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:05.217452 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0fb3ae5a-789d-4e3e-8399-2dbba99ca077 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:05.226993 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0fb3ae5a-789d-4e3e-8399-2dbba99ca077 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.228462 Sep 01 17:40:05.228324 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 246/476] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:04 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:05.231418 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d39c73a4-2ed4-447c-a1af-e3a0d6c37e0a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:05.242799 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d39c73a4-2ed4-447c-a1af-e3a0d6c37e0a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:05.244434 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d39c73a4-2ed4-447c-a1af-e3a0d6c37e0a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:05.245713 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d39c73a4-2ed4-447c-a1af-e3a0d6c37e0a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.220659 Sep 01 17:40:05.246441 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 231/477] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:05 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:06.251810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-be8a46ea-1d44-429c-819c-1fd7ff9ceedd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:06.252421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-be8a46ea-1d44-429c-819c-1fd7ff9ceedd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:06.260407 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-be8a46ea-1d44-429c-819c-1fd7ff9ceedd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:06.261085 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-be8a46ea-1d44-429c-819c-1fd7ff9ceedd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:06.261931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-be8a46ea-1d44-429c-819c-1fd7ff9ceedd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:06.262680 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-be8a46ea-1d44-429c-819c-1fd7ff9ceedd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:06.263146 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-be8a46ea-1d44-429c-819c-1fd7ff9ceedd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:06.263786 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-be8a46ea-1d44-429c-819c-1fd7ff9ceedd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:06.274905 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-373ab069-31f2-4c0e-9192-dde7255e7acf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:06.274905 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-373ab069-31f2-4c0e-9192-dde7255e7acf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:06.277429 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-373ab069-31f2-4c0e-9192-dde7255e7acf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:06.278103 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-373ab069-31f2-4c0e-9192-dde7255e7acf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:06.279475 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-373ab069-31f2-4c0e-9192-dde7255e7acf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:06.279475 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-373ab069-31f2-4c0e-9192-dde7255e7acf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:06.279865 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-373ab069-31f2-4c0e-9192-dde7255e7acf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:06.280413 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-373ab069-31f2-4c0e-9192-dde7255e7acf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:06.493988 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-be8a46ea-1d44-429c-819c-1fd7ff9ceedd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:06.501452 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-373ab069-31f2-4c0e-9192-dde7255e7acf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:06.509313 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-be8a46ea-1d44-429c-819c-1fd7ff9ceedd tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.259308 Sep 01 17:40:06.510863 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 247/478] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:06 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:06.527449 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-373ab069-31f2-4c0e-9192-dde7255e7acf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:06.528950 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-373ab069-31f2-4c0e-9192-dde7255e7acf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:06.530282 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-373ab069-31f2-4c0e-9192-dde7255e7acf tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.265131 Sep 01 17:40:06.530921 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 232/479] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:06 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:07.531360 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8825a3cc-b39c-496c-a6cc-386b04abd73e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:07.532067 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8825a3cc-b39c-496c-a6cc-386b04abd73e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:07.540383 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8825a3cc-b39c-496c-a6cc-386b04abd73e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:07.540881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8825a3cc-b39c-496c-a6cc-386b04abd73e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:07.541320 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8825a3cc-b39c-496c-a6cc-386b04abd73e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:07.542061 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8825a3cc-b39c-496c-a6cc-386b04abd73e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:07.542514 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8825a3cc-b39c-496c-a6cc-386b04abd73e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:07.542938 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8825a3cc-b39c-496c-a6cc-386b04abd73e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:07.555651 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-37e2893d-d6c6-4468-9349-121e0c8ca1bd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:07.556263 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-37e2893d-d6c6-4468-9349-121e0c8ca1bd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:07.562710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-37e2893d-d6c6-4468-9349-121e0c8ca1bd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:07.563189 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-37e2893d-d6c6-4468-9349-121e0c8ca1bd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:07.563652 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-37e2893d-d6c6-4468-9349-121e0c8ca1bd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:07.564357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-37e2893d-d6c6-4468-9349-121e0c8ca1bd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:07.564885 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-37e2893d-d6c6-4468-9349-121e0c8ca1bd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:07.565218 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-37e2893d-d6c6-4468-9349-121e0c8ca1bd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:07.756778 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8825a3cc-b39c-496c-a6cc-386b04abd73e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:07.767015 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8825a3cc-b39c-496c-a6cc-386b04abd73e tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.239762 Sep 01 17:40:07.767603 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-37e2893d-d6c6-4468-9349-121e0c8ca1bd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:07.767779 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 248/480] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:07 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:07.777994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-37e2893d-d6c6-4468-9349-121e0c8ca1bd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:07.779463 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-37e2893d-d6c6-4468-9349-121e0c8ca1bd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:07.780691 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-37e2893d-d6c6-4468-9349-121e0c8ca1bd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.230047 Sep 01 17:40:07.781261 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 233/481] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:07 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:08.792017 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1dfc7767-bc03-450f-9159-d66150102c41 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:08.792578 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-1dfc7767-bc03-450f-9159-d66150102c41 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:08.798966 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1dfc7767-bc03-450f-9159-d66150102c41 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:08.799446 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1dfc7767-bc03-450f-9159-d66150102c41 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:08.799878 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1dfc7767-bc03-450f-9159-d66150102c41 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:08.800565 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1dfc7767-bc03-450f-9159-d66150102c41 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:08.801018 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1dfc7767-bc03-450f-9159-d66150102c41 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:08.801436 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1dfc7767-bc03-450f-9159-d66150102c41 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:08.813073 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b290cab6-96cf-4f4f-bf46-4c2201a4ae81 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:08.813720 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b290cab6-96cf-4f4f-bf46-4c2201a4ae81 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:08.820516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b290cab6-96cf-4f4f-bf46-4c2201a4ae81 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:08.821006 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b290cab6-96cf-4f4f-bf46-4c2201a4ae81 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:08.821446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b290cab6-96cf-4f4f-bf46-4c2201a4ae81 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:08.822171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b290cab6-96cf-4f4f-bf46-4c2201a4ae81 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:08.822663 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b290cab6-96cf-4f4f-bf46-4c2201a4ae81 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:08.823051 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b290cab6-96cf-4f4f-bf46-4c2201a4ae81 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:09.014127 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-1dfc7767-bc03-450f-9159-d66150102c41 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:09.021332 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b290cab6-96cf-4f4f-bf46-4c2201a4ae81 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:09.021985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1dfc7767-bc03-450f-9159-d66150102c41 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.234052 Sep 01 17:40:09.022580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 249/482] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:08 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:09.030869 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b290cab6-96cf-4f4f-bf46-4c2201a4ae81 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:09.032301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b290cab6-96cf-4f4f-bf46-4c2201a4ae81 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:09.033460 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b290cab6-96cf-4f4f-bf46-4c2201a4ae81 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.224268 Sep 01 17:40:09.034235 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 234/483] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:08 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:10.043418 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4daf7671-da3d-4272-913b-8382b23e8a3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:10.044029 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4daf7671-da3d-4272-913b-8382b23e8a3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:10.051329 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4daf7671-da3d-4272-913b-8382b23e8a3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:10.051728 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4daf7671-da3d-4272-913b-8382b23e8a3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:10.052878 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4daf7671-da3d-4272-913b-8382b23e8a3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:10.053631 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4daf7671-da3d-4272-913b-8382b23e8a3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:10.054440 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4daf7671-da3d-4272-913b-8382b23e8a3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:10.054922 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4daf7671-da3d-4272-913b-8382b23e8a3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:10.061452 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d2b2a402-cffa-490e-ac43-bf344657ce34 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:10.062747 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d2b2a402-cffa-490e-ac43-bf344657ce34 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:10.080939 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d2b2a402-cffa-490e-ac43-bf344657ce34 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:10.081424 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d2b2a402-cffa-490e-ac43-bf344657ce34 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:10.081882 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d2b2a402-cffa-490e-ac43-bf344657ce34 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:10.082584 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d2b2a402-cffa-490e-ac43-bf344657ce34 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:10.083039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d2b2a402-cffa-490e-ac43-bf344657ce34 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:10.083597 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d2b2a402-cffa-490e-ac43-bf344657ce34 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:10.282600 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4daf7671-da3d-4272-913b-8382b23e8a3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:10.292132 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4daf7671-da3d-4272-913b-8382b23e8a3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.252440 Sep 01 17:40:10.296267 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d2b2a402-cffa-490e-ac43-bf344657ce34 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:10.305994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 250/484] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:10 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:10.307841 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d2b2a402-cffa-490e-ac43-bf344657ce34 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:10.309297 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d2b2a402-cffa-490e-ac43-bf344657ce34 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:10.310524 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d2b2a402-cffa-490e-ac43-bf344657ce34 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.254628 Sep 01 17:40:10.311073 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 235/485] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:10 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:11.156687 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-d7bb4525-ecba-4443-98e6-53da68c67e38 req-de879a7d-f150-4660-a0e0-b4b47beda605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c4d577-d281-42b7-b448-d38b39a7ee39", "name": "network-vif-plugged", "status": "completed", "tag": "43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:11.170512 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-d7bb4525-ecba-4443-98e6-53da68c67e38 req-de879a7d-f150-4660-a0e0-b4b47beda605 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:11.171045 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-d7bb4525-ecba-4443-98e6-53da68c67e38 req-de879a7d-f150-4660-a0e0-b4b47beda605 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:11.171801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-d7bb4525-ecba-4443-98e6-53da68c67e38 req-de879a7d-f150-4660-a0e0-b4b47beda605 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:11.184798 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-d7bb4525-ecba-4443-98e6-53da68c67e38 req-de879a7d-f150-4660-a0e0-b4b47beda605 service nova] Creating event network-vif-plugged:43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c for instance 14c4d577-d281-42b7-b448-d38b39a7ee39 on hv-cinder-83976 Sep 01 17:40:11.189613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-d7bb4525-ecba-4443-98e6-53da68c67e38 req-de879a7d-f150-4660-a0e0-b4b47beda605 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036438 Sep 01 17:40:11.191105 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 251/486] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:11.301899 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9937b36f-5235-4ee6-b39e-1ad9126301c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Action: 'create', calling method: .version_select at 0x7f354a738040>, body: {"keypair": {"name": "tempest-keypair-961420263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+J4ZcAiblDGgcFNhqp/hRQHhJR1GQq8PUCF0aBt1rtb6TI8ErrdD/fy8LSZ/B28xFR1mxVE8SgSGhXrB3jvksAvn4Xgjq3XWpHuPIvsca0UfsmCzWl+ED5H7vVJQPuzg=="}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:11.315626 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-805635c2-6795-4f40-90fc-0b8f0d46d5b9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:11.316538 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-805635c2-6795-4f40-90fc-0b8f0d46d5b9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:11.321048 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-9937b36f-5235-4ee6-b39e-1ad9126301c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for project 1cf7216d5c904b24a9665755720cf287. Resources: {'key_pairs'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:40:11.324685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-805635c2-6795-4f40-90fc-0b8f0d46d5b9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:11.325044 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-9937b36f-5235-4ee6-b39e-1ad9126301c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for user d3848643d2c44951b78814ccf7d504af and project 1cf7216d5c904b24a9665755720cf287. Resources: {'key_pairs'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:40:11.325341 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-805635c2-6795-4f40-90fc-0b8f0d46d5b9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:11.325885 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-805635c2-6795-4f40-90fc-0b8f0d46d5b9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:11.326667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-805635c2-6795-4f40-90fc-0b8f0d46d5b9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:11.327227 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-805635c2-6795-4f40-90fc-0b8f0d46d5b9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:11.327724 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-805635c2-6795-4f40-90fc-0b8f0d46d5b9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:11.352060 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9937b36f-5235-4ee6-b39e-1ad9126301c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054158 Sep 01 17:40:11.352742 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 236/487] 10.222.0.100 () {60 vars in 1164 bytes} [Thu Sep 1 17:40:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:11.358888 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ee0651c4-8c29-4eb3-bf14-6a0dce1f56c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:11.358888 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ee0651c4-8c29-4eb3-bf14-6a0dce1f56c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:11.367284 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ee0651c4-8c29-4eb3-bf14-6a0dce1f56c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:11.367780 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ee0651c4-8c29-4eb3-bf14-6a0dce1f56c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:11.368309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ee0651c4-8c29-4eb3-bf14-6a0dce1f56c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:11.369025 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ee0651c4-8c29-4eb3-bf14-6a0dce1f56c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:11.369477 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ee0651c4-8c29-4eb3-bf14-6a0dce1f56c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:11.369931 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ee0651c4-8c29-4eb3-bf14-6a0dce1f56c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:11.535788 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-805635c2-6795-4f40-90fc-0b8f0d46d5b9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:11.544908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-805635c2-6795-4f40-90fc-0b8f0d46d5b9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.233972 Sep 01 17:40:11.545514 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 252/488] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:11 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:11.571067 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ee0651c4-8c29-4eb3-bf14-6a0dce1f56c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:11.580727 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ee0651c4-8c29-4eb3-bf14-6a0dce1f56c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:11.582249 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ee0651c4-8c29-4eb3-bf14-6a0dce1f56c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:11.583503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ee0651c4-8c29-4eb3-bf14-6a0dce1f56c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.229789 Sep 01 17:40:11.594497 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 237/489] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:11 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:12.568780 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cb5cd3ac-4f13-40be-a292-95b034dd742c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:12.569789 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cb5cd3ac-4f13-40be-a292-95b034dd742c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:12.580426 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb5cd3ac-4f13-40be-a292-95b034dd742c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:12.581336 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb5cd3ac-4f13-40be-a292-95b034dd742c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:12.582009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb5cd3ac-4f13-40be-a292-95b034dd742c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:12.582911 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb5cd3ac-4f13-40be-a292-95b034dd742c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:12.583565 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb5cd3ac-4f13-40be-a292-95b034dd742c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:12.584188 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb5cd3ac-4f13-40be-a292-95b034dd742c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:12.608418 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8cdab3bf-3cb2-460b-9d7a-fed9f35b65bb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:12.610525 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8cdab3bf-3cb2-460b-9d7a-fed9f35b65bb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:12.620376 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8cdab3bf-3cb2-460b-9d7a-fed9f35b65bb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:12.621402 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8cdab3bf-3cb2-460b-9d7a-fed9f35b65bb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:12.621402 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8cdab3bf-3cb2-460b-9d7a-fed9f35b65bb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:12.622121 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8cdab3bf-3cb2-460b-9d7a-fed9f35b65bb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:12.622641 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8cdab3bf-3cb2-460b-9d7a-fed9f35b65bb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:12.623068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8cdab3bf-3cb2-460b-9d7a-fed9f35b65bb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:12.908668 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cb5cd3ac-4f13-40be-a292-95b034dd742c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:12.917631 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8cdab3bf-3cb2-460b-9d7a-fed9f35b65bb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:12.918428 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cb5cd3ac-4f13-40be-a292-95b034dd742c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.355008 Sep 01 17:40:12.919093 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 253/490] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:12 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:12.928481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8cdab3bf-3cb2-460b-9d7a-fed9f35b65bb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:12.930044 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8cdab3bf-3cb2-460b-9d7a-fed9f35b65bb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:12.931325 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8cdab3bf-3cb2-460b-9d7a-fed9f35b65bb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1757 microversion: 2.20 time: 0.328078 Sep 01 17:40:12.932134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 238/491] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:12 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1757 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:13.107248 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-90866119", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "633c7f8a-adb2-49f1-988f-caf4bcddf2dc"}], "security_groups": [{"name": "tempest-securitygroup--33251268"}], "key_name": "tempest-keypair-961420263", "user_data": "}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:13.212076 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.network.neutron [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] validate_networks() for [('633c7f8a-adb2-49f1-988f-caf4bcddf2dc', None, None, None, None, None)] {{(pid=127233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:40:13.593895 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Flavor limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:40:13.594478 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Image limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:40:13.594771 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Flavor pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:40:13.595203 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Image pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:40:13.595614 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:40:13.604759 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:13.605189 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:13.605649 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:13.606376 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:13.606862 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:13.607287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:13.624531 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for project 1cf7216d5c904b24a9665755720cf287. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:40:13.628450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for user d3848643d2c44951b78814ccf7d504af and project 1cf7216d5c904b24a9665755720cf287. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:40:13.640444 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Going to run 1 instances... {{(pid=127233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:40:13.642788 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:40:13.691434 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3c40194d-e696-4674-9e4b-c22880ba3fe3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.588483 Sep 01 17:40:13.692079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 254/492] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:40:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:40:13.704009 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9edc76b5-6014-4023-9245-a3212a5ac923 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:13.704622 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9edc76b5-6014-4023-9245-a3212a5ac923 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:13.762732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9edc76b5-6014-4023-9245-a3212a5ac923 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:13.769616 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9edc76b5-6014-4023-9245-a3212a5ac923 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1243 microversion: 2.1 time: 0.069632 Sep 01 17:40:13.770361 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 239/493] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:13 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1243 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:13.940912 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8f5bd23d-0264-4ae9-8037-12cddb751317 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:13.941694 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8f5bd23d-0264-4ae9-8037-12cddb751317 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:13.951173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f5bd23d-0264-4ae9-8037-12cddb751317 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:13.951663 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f5bd23d-0264-4ae9-8037-12cddb751317 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:13.952480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f5bd23d-0264-4ae9-8037-12cddb751317 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:13.953355 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f5bd23d-0264-4ae9-8037-12cddb751317 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:13.954010 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f5bd23d-0264-4ae9-8037-12cddb751317 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:13.954709 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f5bd23d-0264-4ae9-8037-12cddb751317 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:13.959278 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9b193092-3e23-405a-b20c-6f502aab5647 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:13.959958 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9b193092-3e23-405a-b20c-6f502aab5647 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:13.961223 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=100 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:13.970124 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9b193092-3e23-405a-b20c-6f502aab5647 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:13.970700 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9b193092-3e23-405a-b20c-6f502aab5647 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:13.971236 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9b193092-3e23-405a-b20c-6f502aab5647 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:13.972072 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9b193092-3e23-405a-b20c-6f502aab5647 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:13.972501 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9b193092-3e23-405a-b20c-6f502aab5647 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:13.972933 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9b193092-3e23-405a-b20c-6f502aab5647 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:14.278504 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8f5bd23d-0264-4ae9-8037-12cddb751317 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:14.286212 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8f5bd23d-0264-4ae9-8037-12cddb751317 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.350912 Sep 01 17:40:14.287319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 255/494] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:13 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:14.293423 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-99217f53-d597-447b-a174-6f6ef9fa9db1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "044dacc7-9c15-4894-9825-15127b94aa9f"}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:14.297006 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-99217f53-d597-447b-a174-6f6ef9fa9db1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:14.309064 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-99217f53-d597-447b-a174-6f6ef9fa9db1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:14.309838 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-99217f53-d597-447b-a174-6f6ef9fa9db1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:14.310279 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-99217f53-d597-447b-a174-6f6ef9fa9db1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:14.310596 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9b193092-3e23-405a-b20c-6f502aab5647 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:14.310991 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-99217f53-d597-447b-a174-6f6ef9fa9db1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:14.311449 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-99217f53-d597-447b-a174-6f6ef9fa9db1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:14.311880 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-99217f53-d597-447b-a174-6f6ef9fa9db1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:14.320601 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9b193092-3e23-405a-b20c-6f502aab5647 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:14.325001 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9b193092-3e23-405a-b20c-6f502aab5647 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:14.325001 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9b193092-3e23-405a-b20c-6f502aab5647 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.371279 Sep 01 17:40:14.325835 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 240/495] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:13 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:14.763171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-99217f53-d597-447b-a174-6f6ef9fa9db1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "POST /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473554 Sep 01 17:40:14.763943 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 256/496] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:40:14 2022] POST /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-volume_attachments => generated 194 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:14.791330 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c45aaf23-cbc4-4703-98ce-de9562325c12 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:14.791946 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c45aaf23-cbc4-4703-98ce-de9562325c12 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:14.798265 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c45aaf23-cbc4-4703-98ce-de9562325c12 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:14.798750 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c45aaf23-cbc4-4703-98ce-de9562325c12 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:14.799185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c45aaf23-cbc4-4703-98ce-de9562325c12 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:14.799875 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c45aaf23-cbc4-4703-98ce-de9562325c12 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:14.800323 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c45aaf23-cbc4-4703-98ce-de9562325c12 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:14.800746 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c45aaf23-cbc4-4703-98ce-de9562325c12 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:14.866738 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c45aaf23-cbc4-4703-98ce-de9562325c12 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:14.874572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c45aaf23-cbc4-4703-98ce-de9562325c12 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1295 microversion: 2.1 time: 0.088069 Sep 01 17:40:14.875136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 241/497] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:14 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1295 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:15.309138 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-571d8435-1f86-4bce-90d0-dd518253557d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:15.309876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-571d8435-1f86-4bce-90d0-dd518253557d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:15.316208 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-571d8435-1f86-4bce-90d0-dd518253557d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:15.316691 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-571d8435-1f86-4bce-90d0-dd518253557d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:15.317127 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-571d8435-1f86-4bce-90d0-dd518253557d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:15.317939 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-571d8435-1f86-4bce-90d0-dd518253557d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:15.318437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-571d8435-1f86-4bce-90d0-dd518253557d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:15.318863 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-571d8435-1f86-4bce-90d0-dd518253557d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:15.350107 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-14a0ff7a-1e17-4d04-99bf-8d5767524b9d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:15.350718 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-14a0ff7a-1e17-4d04-99bf-8d5767524b9d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:15.356770 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14a0ff7a-1e17-4d04-99bf-8d5767524b9d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:15.357263 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14a0ff7a-1e17-4d04-99bf-8d5767524b9d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:15.357733 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14a0ff7a-1e17-4d04-99bf-8d5767524b9d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:15.358434 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14a0ff7a-1e17-4d04-99bf-8d5767524b9d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:15.358888 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14a0ff7a-1e17-4d04-99bf-8d5767524b9d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:15.359315 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14a0ff7a-1e17-4d04-99bf-8d5767524b9d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:15.542408 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-571d8435-1f86-4bce-90d0-dd518253557d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:15.556445 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-571d8435-1f86-4bce-90d0-dd518253557d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1362 microversion: 2.1 time: 0.251605 Sep 01 17:40:15.570312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 257/498] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:15 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:15.611270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-14a0ff7a-1e17-4d04-99bf-8d5767524b9d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:15.620490 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-14a0ff7a-1e17-4d04-99bf-8d5767524b9d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:15.621975 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-14a0ff7a-1e17-4d04-99bf-8d5767524b9d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:15.623154 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-14a0ff7a-1e17-4d04-99bf-8d5767524b9d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.277677 Sep 01 17:40:15.628626 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 242/499] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:15 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:15.896908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d23a8503-cba9-459e-8264-7557fc9ee1cf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:15.897510 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d23a8503-cba9-459e-8264-7557fc9ee1cf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:15.904111 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d23a8503-cba9-459e-8264-7557fc9ee1cf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:15.904597 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d23a8503-cba9-459e-8264-7557fc9ee1cf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:15.905033 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d23a8503-cba9-459e-8264-7557fc9ee1cf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:15.905792 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d23a8503-cba9-459e-8264-7557fc9ee1cf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:15.906234 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d23a8503-cba9-459e-8264-7557fc9ee1cf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:15.906662 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d23a8503-cba9-459e-8264-7557fc9ee1cf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:15.974794 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d23a8503-cba9-459e-8264-7557fc9ee1cf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:15.983117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d23a8503-cba9-459e-8264-7557fc9ee1cf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1295 microversion: 2.1 time: 0.090283 Sep 01 17:40:15.983788 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 258/500] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:15 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:16.590579 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c2b0fee8-a282-4b2a-b4bc-86eefc9d8d72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:16.591235 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c2b0fee8-a282-4b2a-b4bc-86eefc9d8d72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:16.597191 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c2b0fee8-a282-4b2a-b4bc-86eefc9d8d72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:16.597830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c2b0fee8-a282-4b2a-b4bc-86eefc9d8d72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:16.598190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c2b0fee8-a282-4b2a-b4bc-86eefc9d8d72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:16.599387 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c2b0fee8-a282-4b2a-b4bc-86eefc9d8d72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:16.599856 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c2b0fee8-a282-4b2a-b4bc-86eefc9d8d72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:16.600265 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c2b0fee8-a282-4b2a-b4bc-86eefc9d8d72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:16.647629 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-bb5ebdca-e6cd-493a-9cc6-9e333c538525 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:16.648293 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-bb5ebdca-e6cd-493a-9cc6-9e333c538525 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:16.654907 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bb5ebdca-e6cd-493a-9cc6-9e333c538525 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:16.655398 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bb5ebdca-e6cd-493a-9cc6-9e333c538525 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:16.655837 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bb5ebdca-e6cd-493a-9cc6-9e333c538525 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:16.656542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bb5ebdca-e6cd-493a-9cc6-9e333c538525 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:16.657004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bb5ebdca-e6cd-493a-9cc6-9e333c538525 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:16.657845 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bb5ebdca-e6cd-493a-9cc6-9e333c538525 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:16.774180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c2b0fee8-a282-4b2a-b4bc-86eefc9d8d72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:16.782269 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c2b0fee8-a282-4b2a-b4bc-86eefc9d8d72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1552 microversion: 2.1 time: 0.195803 Sep 01 17:40:16.783211 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 243/501] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:16 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1552 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:16.803650 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-81ccb2e0-e9a0-417e-92f1-a7837858fba8 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:16.804259 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-81ccb2e0-e9a0-417e-92f1-a7837858fba8 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:16.810824 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81ccb2e0-e9a0-417e-92f1-a7837858fba8 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:16.810824 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81ccb2e0-e9a0-417e-92f1-a7837858fba8 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:16.811172 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81ccb2e0-e9a0-417e-92f1-a7837858fba8 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:16.813433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81ccb2e0-e9a0-417e-92f1-a7837858fba8 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:16.813433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81ccb2e0-e9a0-417e-92f1-a7837858fba8 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:16.813433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81ccb2e0-e9a0-417e-92f1-a7837858fba8 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:16.853463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-bb5ebdca-e6cd-493a-9cc6-9e333c538525 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:16.868805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-bb5ebdca-e6cd-493a-9cc6-9e333c538525 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:16.870293 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-bb5ebdca-e6cd-493a-9cc6-9e333c538525 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:16.871530 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-bb5ebdca-e6cd-493a-9cc6-9e333c538525 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.228534 Sep 01 17:40:16.872203 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 259/502] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:16 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:16.961518 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-81ccb2e0-e9a0-417e-92f1-a7837858fba8 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:16.969561 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-81ccb2e0-e9a0-417e-92f1-a7837858fba8 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1552 microversion: 2.1 time: 0.169860 Sep 01 17:40:16.970165 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 244/503] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:16 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:16.990508 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b9c9a086-6a77-4137-8f4b-01c8638611b1 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:16.995505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b9c9a086-6a77-4137-8f4b-01c8638611b1 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:16.996266 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-b9c9a086-6a77-4137-8f4b-01c8638611b1 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Searching by: {'deleted': False, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27'} {{(pid=127233) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 17:40:17.003285 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b9c9a086-6a77-4137-8f4b-01c8638611b1 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:17.003863 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b9c9a086-6a77-4137-8f4b-01c8638611b1 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:17.004189 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b9c9a086-6a77-4137-8f4b-01c8638611b1 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:17.004916 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b9c9a086-6a77-4137-8f4b-01c8638611b1 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:17.005399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b9c9a086-6a77-4137-8f4b-01c8638611b1 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:17.005844 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b9c9a086-6a77-4137-8f4b-01c8638611b1 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:17.007090 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c9c210cb-035d-4af8-863b-d0772bde2160 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:17.007707 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c9c210cb-035d-4af8-863b-d0772bde2160 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:17.013888 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c9c210cb-035d-4af8-863b-d0772bde2160 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:17.014412 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c9c210cb-035d-4af8-863b-d0772bde2160 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:17.014859 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c9c210cb-035d-4af8-863b-d0772bde2160 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:17.015616 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c9c210cb-035d-4af8-863b-d0772bde2160 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:17.016024 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c9c210cb-035d-4af8-863b-d0772bde2160 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:17.016454 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c9c210cb-035d-4af8-863b-d0772bde2160 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:17.081288 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c9c210cb-035d-4af8-863b-d0772bde2160 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:17.089007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c9c210cb-035d-4af8-863b-d0772bde2160 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1303 microversion: 2.1 time: 0.086263 Sep 01 17:40:17.089590 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 245/504] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:17 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1303 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:17.098092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.multi_cell_list [None req-b9c9a086-6a77-4137-8f4b-01c8638611b1 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127233) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 17:40:17.191834 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-b9c9a086-6a77-4137-8f4b-01c8638611b1 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.205763 Sep 01 17:40:17.192421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 260/505] 10.222.0.100 () {58 vars in 1130 bytes} [Thu Sep 1 17:40:16 2022] GET /compute/v2.1/servers => generated 344 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:40:17.204946 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a752e7a3-227c-44d7-830b-d4be1fdbd636 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:17.205556 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a752e7a3-227c-44d7-830b-d4be1fdbd636 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:17.211863 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a752e7a3-227c-44d7-830b-d4be1fdbd636 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:17.212358 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a752e7a3-227c-44d7-830b-d4be1fdbd636 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:17.212802 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a752e7a3-227c-44d7-830b-d4be1fdbd636 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:17.213507 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a752e7a3-227c-44d7-830b-d4be1fdbd636 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:17.213997 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a752e7a3-227c-44d7-830b-d4be1fdbd636 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:17.218371 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a752e7a3-227c-44d7-830b-d4be1fdbd636 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:17.780349 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a752e7a3-227c-44d7-830b-d4be1fdbd636 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:17.791537 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a752e7a3-227c-44d7-830b-d4be1fdbd636 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1552 microversion: 2.1 time: 0.590796 Sep 01 17:40:17.792579 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 246/506] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:17 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1552 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:17.895079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-86ff644a-2773-4cc0-8e94-7e0755565d42 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:17.895755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-86ff644a-2773-4cc0-8e94-7e0755565d42 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:17.902897 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86ff644a-2773-4cc0-8e94-7e0755565d42 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:17.903389 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86ff644a-2773-4cc0-8e94-7e0755565d42 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:17.903826 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86ff644a-2773-4cc0-8e94-7e0755565d42 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:17.904529 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86ff644a-2773-4cc0-8e94-7e0755565d42 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:17.905208 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86ff644a-2773-4cc0-8e94-7e0755565d42 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:17.905663 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86ff644a-2773-4cc0-8e94-7e0755565d42 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:18.105453 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-946c3ee3-b068-4620-aaba-5f65e7e93f49 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:18.108880 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-946c3ee3-b068-4620-aaba-5f65e7e93f49 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:18.117279 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-946c3ee3-b068-4620-aaba-5f65e7e93f49 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:18.118157 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-946c3ee3-b068-4620-aaba-5f65e7e93f49 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:18.118785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-946c3ee3-b068-4620-aaba-5f65e7e93f49 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:18.119692 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-946c3ee3-b068-4620-aaba-5f65e7e93f49 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:18.120141 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-946c3ee3-b068-4620-aaba-5f65e7e93f49 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:18.120722 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-946c3ee3-b068-4620-aaba-5f65e7e93f49 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:18.154871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-946c3ee3-b068-4620-aaba-5f65e7e93f49 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lazy-loading 'flavor' on Instance uuid fd635ada-9195-43da-a0a3-b131c9132dd6 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:40:18.168638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=100 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:18.175111 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-86ff644a-2773-4cc0-8e94-7e0755565d42 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:18.198195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-86ff644a-2773-4cc0-8e94-7e0755565d42 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:18.205694 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-86ff644a-2773-4cc0-8e94-7e0755565d42 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:18.207667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-86ff644a-2773-4cc0-8e94-7e0755565d42 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.317254 Sep 01 17:40:18.221765 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 261/507] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:17 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:18.234058 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-bfd522fa-3309-46cb-9832-96dd0d62a813 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:18.235081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-bfd522fa-3309-46cb-9832-96dd0d62a813 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:18.252907 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bfd522fa-3309-46cb-9832-96dd0d62a813 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:18.257463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bfd522fa-3309-46cb-9832-96dd0d62a813 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:18.258120 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bfd522fa-3309-46cb-9832-96dd0d62a813 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:18.260604 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bfd522fa-3309-46cb-9832-96dd0d62a813 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:18.261780 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bfd522fa-3309-46cb-9832-96dd0d62a813 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:18.263587 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bfd522fa-3309-46cb-9832-96dd0d62a813 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:18.374876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-946c3ee3-b068-4620-aaba-5f65e7e93f49 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "POST /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/action" status: 200 len: 32 microversion: 2.1 time: 0.276451 Sep 01 17:40:18.375726 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 247/508] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:40:18 2022] POST /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/action => generated 32 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:40:18.382360 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-0842327f-81af-41fe-ba24-2f5ab1b1eb85 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:18.382973 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-0842327f-81af-41fe-ba24-2f5ab1b1eb85 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:18.389820 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0842327f-81af-41fe-ba24-2f5ab1b1eb85 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:18.390304 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0842327f-81af-41fe-ba24-2f5ab1b1eb85 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:18.390744 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0842327f-81af-41fe-ba24-2f5ab1b1eb85 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:18.391445 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0842327f-81af-41fe-ba24-2f5ab1b1eb85 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:18.392232 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0842327f-81af-41fe-ba24-2f5ab1b1eb85 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:18.392818 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0842327f-81af-41fe-ba24-2f5ab1b1eb85 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:18.401592 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-bfd522fa-3309-46cb-9832-96dd0d62a813 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:18.429293 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-bfd522fa-3309-46cb-9832-96dd0d62a813 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1301 microversion: 2.1 time: 0.214794 Sep 01 17:40:18.430151 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 262/509] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:18 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1301 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:18.435304 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-535ea1d6-5161-4599-b75c-c25f6ea4fadf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:18.435910 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-535ea1d6-5161-4599-b75c-c25f6ea4fadf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:18.442285 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-535ea1d6-5161-4599-b75c-c25f6ea4fadf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:18.444106 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-535ea1d6-5161-4599-b75c-c25f6ea4fadf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:18.444851 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-535ea1d6-5161-4599-b75c-c25f6ea4fadf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:18.445798 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-535ea1d6-5161-4599-b75c-c25f6ea4fadf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:18.446497 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-535ea1d6-5161-4599-b75c-c25f6ea4fadf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:18.447096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-535ea1d6-5161-4599-b75c-c25f6ea4fadf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:18.644373 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-0842327f-81af-41fe-ba24-2f5ab1b1eb85 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lazy-loading 'services' on Instance uuid 46ef555c-0fec-491a-bc16-4e60b61a338d {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:40:18.825349 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-0842327f-81af-41fe-ba24-2f5ab1b1eb85 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "DELETE /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d/os-volume_attachments/6ec39c2a-50a6-4ffe-be1a-b13689b9baa4" status: 202 len: 0 microversion: 2.1 time: 0.447714 Sep 01 17:40:18.826398 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 248/510] 10.222.0.100 () {58 vars in 1421 bytes} [Thu Sep 1 17:40:18 2022] DELETE /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d/os-volume_attachments/6ec39c2a-50a6-4ffe-be1a-b13689b9baa4 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:40:18.839139 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-535ea1d6-5161-4599-b75c-c25f6ea4fadf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:18.857196 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-535ea1d6-5161-4599-b75c-c25f6ea4fadf tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.425762 Sep 01 17:40:18.858187 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 263/511] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:18 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:19.237051 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e8ee5a49-f7c3-41b4-beef-dd740255ca91 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:19.237776 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e8ee5a49-f7c3-41b4-beef-dd740255ca91 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:19.259296 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e8ee5a49-f7c3-41b4-beef-dd740255ca91 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:19.259799 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e8ee5a49-f7c3-41b4-beef-dd740255ca91 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:19.260249 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e8ee5a49-f7c3-41b4-beef-dd740255ca91 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:19.260978 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e8ee5a49-f7c3-41b4-beef-dd740255ca91 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:19.261440 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e8ee5a49-f7c3-41b4-beef-dd740255ca91 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:19.261918 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e8ee5a49-f7c3-41b4-beef-dd740255ca91 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:19.469738 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a8ea32eb-76f6-40cf-be3a-d68a87b593d9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:19.473107 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a8ea32eb-76f6-40cf-be3a-d68a87b593d9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:19.492177 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a8ea32eb-76f6-40cf-be3a-d68a87b593d9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:19.492768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a8ea32eb-76f6-40cf-be3a-d68a87b593d9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:19.493276 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a8ea32eb-76f6-40cf-be3a-d68a87b593d9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:19.494089 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a8ea32eb-76f6-40cf-be3a-d68a87b593d9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:19.494628 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a8ea32eb-76f6-40cf-be3a-d68a87b593d9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:19.495118 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a8ea32eb-76f6-40cf-be3a-d68a87b593d9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:19.639020 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e8ee5a49-f7c3-41b4-beef-dd740255ca91 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:19.650868 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e8ee5a49-f7c3-41b4-beef-dd740255ca91 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:19.653005 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e8ee5a49-f7c3-41b4-beef-dd740255ca91 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:19.654693 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e8ee5a49-f7c3-41b4-beef-dd740255ca91 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.421970 Sep 01 17:40:19.670940 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 249/512] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:19 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:19.670940 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-78ff97a6-a925-47db-b96e-5252b0ee06e0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7555b696-f5de-4888-8995-adbacd6351eb"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:19.670940 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-78ff97a6-a925-47db-b96e-5252b0ee06e0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:19.684994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-78ff97a6-a925-47db-b96e-5252b0ee06e0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:19.685493 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-78ff97a6-a925-47db-b96e-5252b0ee06e0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:19.685963 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-78ff97a6-a925-47db-b96e-5252b0ee06e0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:19.686766 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-78ff97a6-a925-47db-b96e-5252b0ee06e0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:19.694402 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-78ff97a6-a925-47db-b96e-5252b0ee06e0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:19.695252 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-78ff97a6-a925-47db-b96e-5252b0ee06e0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:19.811422 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a8ea32eb-76f6-40cf-be3a-d68a87b593d9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:19.825917 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a8ea32eb-76f6-40cf-be3a-d68a87b593d9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.372179 Sep 01 17:40:19.826513 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 264/513] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:19 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:19.881194 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-257a223c-fdff-4092-80cc-f7d04dd7f496 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:19.882177 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-257a223c-fdff-4092-80cc-f7d04dd7f496 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:19.889180 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-257a223c-fdff-4092-80cc-f7d04dd7f496 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:19.889830 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-257a223c-fdff-4092-80cc-f7d04dd7f496 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:19.890266 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-257a223c-fdff-4092-80cc-f7d04dd7f496 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:19.890970 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-257a223c-fdff-4092-80cc-f7d04dd7f496 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:19.891420 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-257a223c-fdff-4092-80cc-f7d04dd7f496 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:19.891840 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-257a223c-fdff-4092-80cc-f7d04dd7f496 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:20.075428 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-257a223c-fdff-4092-80cc-f7d04dd7f496 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:20.085292 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-257a223c-fdff-4092-80cc-f7d04dd7f496 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.208766 Sep 01 17:40:20.086119 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 265/514] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:19 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:20.698342 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-27752654-16ff-460c-bede-6a56d3854318 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:20.699446 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-27752654-16ff-460c-bede-6a56d3854318 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:20.711002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27752654-16ff-460c-bede-6a56d3854318 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:20.712001 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27752654-16ff-460c-bede-6a56d3854318 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:20.712532 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27752654-16ff-460c-bede-6a56d3854318 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:20.713396 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27752654-16ff-460c-bede-6a56d3854318 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:20.715187 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27752654-16ff-460c-bede-6a56d3854318 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:20.715905 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27752654-16ff-460c-bede-6a56d3854318 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:20.922659 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-27752654-16ff-460c-bede-6a56d3854318 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:20.934096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-27752654-16ff-460c-bede-6a56d3854318 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:20.935909 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-27752654-16ff-460c-bede-6a56d3854318 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:20.937175 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-27752654-16ff-460c-bede-6a56d3854318 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.255976 Sep 01 17:40:20.938018 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 266/515] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:20 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:20.949625 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-28725e21-b422-4fd7-9722-24609eb4e9e6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:20.949625 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-28725e21-b422-4fd7-9722-24609eb4e9e6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:20.952336 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-28725e21-b422-4fd7-9722-24609eb4e9e6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:20.952850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-28725e21-b422-4fd7-9722-24609eb4e9e6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:20.953296 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-28725e21-b422-4fd7-9722-24609eb4e9e6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:20.954101 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-28725e21-b422-4fd7-9722-24609eb4e9e6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:20.954737 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-28725e21-b422-4fd7-9722-24609eb4e9e6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:20.955175 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-28725e21-b422-4fd7-9722-24609eb4e9e6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:21.201518 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-28725e21-b422-4fd7-9722-24609eb4e9e6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:21.218105 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-28725e21-b422-4fd7-9722-24609eb4e9e6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.278822 Sep 01 17:40:21.218695 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 267/516] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:20 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:21.241893 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3fdf840f-d53b-4597-b857-0ad96ab26cc2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:21.242526 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3fdf840f-d53b-4597-b857-0ad96ab26cc2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:21.252896 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3fdf840f-d53b-4597-b857-0ad96ab26cc2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:21.253561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3fdf840f-d53b-4597-b857-0ad96ab26cc2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:21.254032 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3fdf840f-d53b-4597-b857-0ad96ab26cc2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:21.254754 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3fdf840f-d53b-4597-b857-0ad96ab26cc2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:21.255292 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3fdf840f-d53b-4597-b857-0ad96ab26cc2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:21.255712 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3fdf840f-d53b-4597-b857-0ad96ab26cc2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:21.434183 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3fdf840f-d53b-4597-b857-0ad96ab26cc2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:21.445464 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3fdf840f-d53b-4597-b857-0ad96ab26cc2 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.225612 Sep 01 17:40:21.446544 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 268/517] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:21 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:21.977754 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-9a21f5f7-97f6-4a91-b51f-1e04bc2b51e2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:21.979302 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-9a21f5f7-97f6-4a91-b51f-1e04bc2b51e2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:21.986537 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a21f5f7-97f6-4a91-b51f-1e04bc2b51e2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:21.987186 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a21f5f7-97f6-4a91-b51f-1e04bc2b51e2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:21.987757 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a21f5f7-97f6-4a91-b51f-1e04bc2b51e2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:21.988564 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a21f5f7-97f6-4a91-b51f-1e04bc2b51e2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:21.989289 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a21f5f7-97f6-4a91-b51f-1e04bc2b51e2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:21.990022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a21f5f7-97f6-4a91-b51f-1e04bc2b51e2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:22.267732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-9a21f5f7-97f6-4a91-b51f-1e04bc2b51e2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:22.277948 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-9a21f5f7-97f6-4a91-b51f-1e04bc2b51e2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:22.279851 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-9a21f5f7-97f6-4a91-b51f-1e04bc2b51e2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:22.281130 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-9a21f5f7-97f6-4a91-b51f-1e04bc2b51e2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.308593 Sep 01 17:40:22.293609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 269/518] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:21 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:22.293609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8f86e57c-1f2e-4e8e-9e81-6c3122bf8e1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:22.293609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8f86e57c-1f2e-4e8e-9e81-6c3122bf8e1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:22.296191 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f86e57c-1f2e-4e8e-9e81-6c3122bf8e1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:22.296191 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f86e57c-1f2e-4e8e-9e81-6c3122bf8e1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:22.297104 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f86e57c-1f2e-4e8e-9e81-6c3122bf8e1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:22.301650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f86e57c-1f2e-4e8e-9e81-6c3122bf8e1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:22.301650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f86e57c-1f2e-4e8e-9e81-6c3122bf8e1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:22.301650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f86e57c-1f2e-4e8e-9e81-6c3122bf8e1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:22.301650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:22.457556 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8f86e57c-1f2e-4e8e-9e81-6c3122bf8e1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:22.466308 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8f86e57c-1f2e-4e8e-9e81-6c3122bf8e1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.182613 Sep 01 17:40:22.466892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 270/519] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:22 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:22.471527 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-638f110b-fe0e-4861-9c07-33134a43dbdb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:22.472160 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-638f110b-fe0e-4861-9c07-33134a43dbdb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:22.484528 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-638f110b-fe0e-4861-9c07-33134a43dbdb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:22.485028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-638f110b-fe0e-4861-9c07-33134a43dbdb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:22.485467 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-638f110b-fe0e-4861-9c07-33134a43dbdb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:22.486242 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-638f110b-fe0e-4861-9c07-33134a43dbdb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:22.486700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-638f110b-fe0e-4861-9c07-33134a43dbdb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:22.487223 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-638f110b-fe0e-4861-9c07-33134a43dbdb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:22.663504 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-638f110b-fe0e-4861-9c07-33134a43dbdb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:22.672602 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-638f110b-fe0e-4861-9c07-33134a43dbdb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.204674 Sep 01 17:40:22.673188 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 271/520] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:22 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:23.325206 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e2e61b19-dfd5-4153-91ca-599c85711f63 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:23.325997 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e2e61b19-dfd5-4153-91ca-599c85711f63 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:23.328224 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:23.334881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e2e61b19-dfd5-4153-91ca-599c85711f63 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:23.335446 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e2e61b19-dfd5-4153-91ca-599c85711f63 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:23.335954 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e2e61b19-dfd5-4153-91ca-599c85711f63 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:23.336748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e2e61b19-dfd5-4153-91ca-599c85711f63 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:23.337206 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e2e61b19-dfd5-4153-91ca-599c85711f63 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:23.337663 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e2e61b19-dfd5-4153-91ca-599c85711f63 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:23.519353 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e2e61b19-dfd5-4153-91ca-599c85711f63 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:23.537690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e2e61b19-dfd5-4153-91ca-599c85711f63 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:23.539408 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e2e61b19-dfd5-4153-91ca-599c85711f63 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:23.540593 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e2e61b19-dfd5-4153-91ca-599c85711f63 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.219378 Sep 01 17:40:23.541347 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 272/521] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:23 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:23.545887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2630b0cd-316d-4e87-abbf-da47e1747c59 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:23.546546 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2630b0cd-316d-4e87-abbf-da47e1747c59 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:23.557262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2630b0cd-316d-4e87-abbf-da47e1747c59 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:23.557872 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2630b0cd-316d-4e87-abbf-da47e1747c59 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:23.558425 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2630b0cd-316d-4e87-abbf-da47e1747c59 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:23.559207 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2630b0cd-316d-4e87-abbf-da47e1747c59 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:23.559727 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2630b0cd-316d-4e87-abbf-da47e1747c59 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:23.560240 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2630b0cd-316d-4e87-abbf-da47e1747c59 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:23.636392 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=6 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:23.705983 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2630b0cd-316d-4e87-abbf-da47e1747c59 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:23.714840 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2630b0cd-316d-4e87-abbf-da47e1747c59 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.172417 Sep 01 17:40:23.715430 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 273/522] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:23 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:23.722143 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e7419091-cd9f-4bc8-8325-0c36b1dfad52 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:23.722846 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e7419091-cd9f-4bc8-8325-0c36b1dfad52 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:23.730145 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e7419091-cd9f-4bc8-8325-0c36b1dfad52 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:23.730671 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e7419091-cd9f-4bc8-8325-0c36b1dfad52 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:23.731103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e7419091-cd9f-4bc8-8325-0c36b1dfad52 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:23.731854 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e7419091-cd9f-4bc8-8325-0c36b1dfad52 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:23.732297 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e7419091-cd9f-4bc8-8325-0c36b1dfad52 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:23.732751 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e7419091-cd9f-4bc8-8325-0c36b1dfad52 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:23.767168 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=6 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:23.912151 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e7419091-cd9f-4bc8-8325-0c36b1dfad52 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:23.922058 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e7419091-cd9f-4bc8-8325-0c36b1dfad52 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.205487 Sep 01 17:40:23.922648 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 274/523] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:23 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:24.564612 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8182760a-3ee9-40b5-9125-2901e76fdfbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:24.565282 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8182760a-3ee9-40b5-9125-2901e76fdfbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:24.574543 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8182760a-3ee9-40b5-9125-2901e76fdfbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:24.575043 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8182760a-3ee9-40b5-9125-2901e76fdfbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:24.575718 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8182760a-3ee9-40b5-9125-2901e76fdfbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:24.576444 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8182760a-3ee9-40b5-9125-2901e76fdfbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:24.576914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8182760a-3ee9-40b5-9125-2901e76fdfbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:24.577340 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8182760a-3ee9-40b5-9125-2901e76fdfbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:24.729378 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8182760a-3ee9-40b5-9125-2901e76fdfbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:24.747356 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8182760a-3ee9-40b5-9125-2901e76fdfbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:24.748807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8182760a-3ee9-40b5-9125-2901e76fdfbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:24.750679 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8182760a-3ee9-40b5-9125-2901e76fdfbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.190227 Sep 01 17:40:24.752944 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 275/524] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:24 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:24.756928 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-15b27a2c-859e-4337-a802-c3285bf09e1f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:24.757656 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-15b27a2c-859e-4337-a802-c3285bf09e1f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:24.765251 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15b27a2c-859e-4337-a802-c3285bf09e1f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:24.765777 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15b27a2c-859e-4337-a802-c3285bf09e1f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:24.766211 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15b27a2c-859e-4337-a802-c3285bf09e1f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:24.766922 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15b27a2c-859e-4337-a802-c3285bf09e1f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:24.767376 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15b27a2c-859e-4337-a802-c3285bf09e1f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:24.767792 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15b27a2c-859e-4337-a802-c3285bf09e1f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:24.920127 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-15b27a2c-859e-4337-a802-c3285bf09e1f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:24.928800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-15b27a2c-859e-4337-a802-c3285bf09e1f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.176005 Sep 01 17:40:24.929428 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 276/525] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:24 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:24.943802 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b3b62df5-87d6-4eaf-ba82-dab7662a238e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:24.944720 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-b3b62df5-87d6-4eaf-ba82-dab7662a238e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:24.951091 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3b62df5-87d6-4eaf-ba82-dab7662a238e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:24.951587 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3b62df5-87d6-4eaf-ba82-dab7662a238e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:24.952144 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3b62df5-87d6-4eaf-ba82-dab7662a238e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:24.952867 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3b62df5-87d6-4eaf-ba82-dab7662a238e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:24.953326 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3b62df5-87d6-4eaf-ba82-dab7662a238e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:24.953780 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b3b62df5-87d6-4eaf-ba82-dab7662a238e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:25.115845 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b3b62df5-87d6-4eaf-ba82-dab7662a238e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:25.124772 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-b3b62df5-87d6-4eaf-ba82-dab7662a238e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.185106 Sep 01 17:40:25.129987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 277/526] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:24 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:25.776848 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-987b3bdc-6935-4849-b0b9-34fb1f293ffb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:25.777543 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-987b3bdc-6935-4849-b0b9-34fb1f293ffb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:25.784096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-987b3bdc-6935-4849-b0b9-34fb1f293ffb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:25.784580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-987b3bdc-6935-4849-b0b9-34fb1f293ffb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:25.785011 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-987b3bdc-6935-4849-b0b9-34fb1f293ffb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:25.785740 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-987b3bdc-6935-4849-b0b9-34fb1f293ffb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:25.786219 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-987b3bdc-6935-4849-b0b9-34fb1f293ffb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:25.788657 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-987b3bdc-6935-4849-b0b9-34fb1f293ffb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:25.926273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-987b3bdc-6935-4849-b0b9-34fb1f293ffb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:25.935837 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-987b3bdc-6935-4849-b0b9-34fb1f293ffb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:25.937265 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-987b3bdc-6935-4849-b0b9-34fb1f293ffb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:25.938463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-987b3bdc-6935-4849-b0b9-34fb1f293ffb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.166190 Sep 01 17:40:25.939061 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 278/527] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:25 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:25.963492 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-62c89410-24f3-4ede-a592-fc6ef053a1a4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:25.964244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-62c89410-24f3-4ede-a592-fc6ef053a1a4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:25.970699 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-62c89410-24f3-4ede-a592-fc6ef053a1a4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:25.971193 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-62c89410-24f3-4ede-a592-fc6ef053a1a4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:25.971630 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-62c89410-24f3-4ede-a592-fc6ef053a1a4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:25.972340 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-62c89410-24f3-4ede-a592-fc6ef053a1a4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:25.972806 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-62c89410-24f3-4ede-a592-fc6ef053a1a4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:25.973210 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-62c89410-24f3-4ede-a592-fc6ef053a1a4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:26.147339 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-62c89410-24f3-4ede-a592-fc6ef053a1a4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:26.164361 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-62c89410-24f3-4ede-a592-fc6ef053a1a4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.206511 Sep 01 17:40:26.165685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 279/528] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:25 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:26.170514 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-870fcd07-4f56-45db-9d04-3636e26084f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:26.171122 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-870fcd07-4f56-45db-9d04-3636e26084f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:26.177992 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-870fcd07-4f56-45db-9d04-3636e26084f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:26.178510 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-870fcd07-4f56-45db-9d04-3636e26084f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:26.178946 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-870fcd07-4f56-45db-9d04-3636e26084f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:26.179729 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-870fcd07-4f56-45db-9d04-3636e26084f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:26.180178 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-870fcd07-4f56-45db-9d04-3636e26084f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:26.180598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-870fcd07-4f56-45db-9d04-3636e26084f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:26.369937 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-870fcd07-4f56-45db-9d04-3636e26084f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:26.378883 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-870fcd07-4f56-45db-9d04-3636e26084f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.212115 Sep 01 17:40:26.380340 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 280/529] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:26 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:26.963896 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e5271133-a419-476c-acf5-4a7c7badabff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:26.964612 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e5271133-a419-476c-acf5-4a7c7badabff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:26.970863 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e5271133-a419-476c-acf5-4a7c7badabff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:26.971340 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e5271133-a419-476c-acf5-4a7c7badabff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:26.971769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e5271133-a419-476c-acf5-4a7c7badabff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:26.972453 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e5271133-a419-476c-acf5-4a7c7badabff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:26.972900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e5271133-a419-476c-acf5-4a7c7badabff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:26.973320 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e5271133-a419-476c-acf5-4a7c7badabff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:27.039743 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=4 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:27.212639 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e5271133-a419-476c-acf5-4a7c7badabff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:27.221275 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e5271133-a419-476c-acf5-4a7c7badabff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:27.222816 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e5271133-a419-476c-acf5-4a7c7badabff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:27.225272 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e5271133-a419-476c-acf5-4a7c7badabff tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.265229 Sep 01 17:40:27.225862 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 281/530] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:26 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:27.230312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8ba1f08a-8923-4169-bf18-d0a8d6841668 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:27.230916 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8ba1f08a-8923-4169-bf18-d0a8d6841668 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:27.236836 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8ba1f08a-8923-4169-bf18-d0a8d6841668 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:27.237318 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8ba1f08a-8923-4169-bf18-d0a8d6841668 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:27.237773 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8ba1f08a-8923-4169-bf18-d0a8d6841668 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:27.238469 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8ba1f08a-8923-4169-bf18-d0a8d6841668 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:27.238913 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8ba1f08a-8923-4169-bf18-d0a8d6841668 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:27.239328 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8ba1f08a-8923-4169-bf18-d0a8d6841668 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:27.486282 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8ba1f08a-8923-4169-bf18-d0a8d6841668 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:27.495506 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8ba1f08a-8923-4169-bf18-d0a8d6841668 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.268560 Sep 01 17:40:27.496396 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 282/531] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:27 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:27.514685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-eb63bd02-2cb2-4f54-b7bf-3d9a034b3a2c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:27.515295 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-eb63bd02-2cb2-4f54-b7bf-3d9a034b3a2c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:27.527566 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eb63bd02-2cb2-4f54-b7bf-3d9a034b3a2c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:27.528071 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eb63bd02-2cb2-4f54-b7bf-3d9a034b3a2c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:27.528517 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eb63bd02-2cb2-4f54-b7bf-3d9a034b3a2c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:27.529226 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eb63bd02-2cb2-4f54-b7bf-3d9a034b3a2c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:27.529713 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eb63bd02-2cb2-4f54-b7bf-3d9a034b3a2c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:27.530145 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-eb63bd02-2cb2-4f54-b7bf-3d9a034b3a2c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:27.796898 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-eb63bd02-2cb2-4f54-b7bf-3d9a034b3a2c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:27.798552 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-78ff97a6-a925-47db-b96e-5252b0ee06e0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "POST /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.141563 Sep 01 17:40:27.799272 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 250/532] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:40:19 2022] POST /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments => generated 194 bytes in 8143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:27.811675 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-eb63bd02-2cb2-4f54-b7bf-3d9a034b3a2c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.300992 Sep 01 17:40:27.812460 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 283/533] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:27 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:27.937397 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-bf84b3d8-cb84-4128-99a9-333898512fb7 req-07a9c72e-26d3-4b2a-8250-21afa2bb3e1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e176cb-aabb-40b5-a79d-acf5d061b2da", "tag": "5be3ac5e-b565-42ad-abf6-c17408c0347c"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:27.943462 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:27.949488 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-bf84b3d8-cb84-4128-99a9-333898512fb7 req-07a9c72e-26d3-4b2a-8250-21afa2bb3e1e service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:27.949975 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-bf84b3d8-cb84-4128-99a9-333898512fb7 req-07a9c72e-26d3-4b2a-8250-21afa2bb3e1e service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:27.950404 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-bf84b3d8-cb84-4128-99a9-333898512fb7 req-07a9c72e-26d3-4b2a-8250-21afa2bb3e1e service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:27.962167 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-bf84b3d8-cb84-4128-99a9-333898512fb7 req-07a9c72e-26d3-4b2a-8250-21afa2bb3e1e service nova] Creating event network-changed:5be3ac5e-b565-42ad-abf6-c17408c0347c for instance 92e176cb-aabb-40b5-a79d-acf5d061b2da on hv-cinder-83976 Sep 01 17:40:27.966850 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-bf84b3d8-cb84-4128-99a9-333898512fb7 req-07a9c72e-26d3-4b2a-8250-21afa2bb3e1e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034305 Sep 01 17:40:27.967440 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 251/534] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:28.248317 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c8726bd8-20c2-4e29-a47a-12ad369a0972 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:28.248924 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c8726bd8-20c2-4e29-a47a-12ad369a0972 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:28.256136 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c8726bd8-20c2-4e29-a47a-12ad369a0972 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:28.256620 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c8726bd8-20c2-4e29-a47a-12ad369a0972 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:28.257303 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c8726bd8-20c2-4e29-a47a-12ad369a0972 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:28.258433 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c8726bd8-20c2-4e29-a47a-12ad369a0972 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:28.259081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c8726bd8-20c2-4e29-a47a-12ad369a0972 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:28.259689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c8726bd8-20c2-4e29-a47a-12ad369a0972 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:28.524207 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c8726bd8-20c2-4e29-a47a-12ad369a0972 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:28.550163 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-227c56dc-e475-4a91-9a9a-1caef642dbd4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:28.552441 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c8726bd8-20c2-4e29-a47a-12ad369a0972 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:28.555204 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c8726bd8-20c2-4e29-a47a-12ad369a0972 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:28.559939 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-c8726bd8-20c2-4e29-a47a-12ad369a0972 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.314129 Sep 01 17:40:28.561543 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 284/535] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:28 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:28.570448 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-227c56dc-e475-4a91-9a9a-1caef642dbd4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:28.610827 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-227c56dc-e475-4a91-9a9a-1caef642dbd4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:28.611786 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-227c56dc-e475-4a91-9a9a-1caef642dbd4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:28.612477 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-227c56dc-e475-4a91-9a9a-1caef642dbd4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:28.613770 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-227c56dc-e475-4a91-9a9a-1caef642dbd4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:28.616404 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-227c56dc-e475-4a91-9a9a-1caef642dbd4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:28.617051 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-227c56dc-e475-4a91-9a9a-1caef642dbd4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:28.679290 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0803e0e6-d809-41fe-8578-fdc9dd965604 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:28.679818 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0803e0e6-d809-41fe-8578-fdc9dd965604 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:28.686275 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0803e0e6-d809-41fe-8578-fdc9dd965604 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:28.686845 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0803e0e6-d809-41fe-8578-fdc9dd965604 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:28.687271 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0803e0e6-d809-41fe-8578-fdc9dd965604 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:28.691041 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0803e0e6-d809-41fe-8578-fdc9dd965604 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:28.691041 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0803e0e6-d809-41fe-8578-fdc9dd965604 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:28.691041 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0803e0e6-d809-41fe-8578-fdc9dd965604 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:28.716486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0803e0e6-d809-41fe-8578-fdc9dd965604 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Going to try to terminate instance {{(pid=127233) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:40:28.760418 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:28.778403 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-227c56dc-e475-4a91-9a9a-1caef642dbd4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:28.789081 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-227c56dc-e475-4a91-9a9a-1caef642dbd4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.275573 Sep 01 17:40:28.789995 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 252/536] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:28 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:28.824096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0803e0e6-d809-41fe-8578-fdc9dd965604 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "DELETE /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 204 len: 0 microversion: 2.1 time: 0.149022 Sep 01 17:40:28.825089 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 285/537] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:40:28 2022] DELETE /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 17:40:28.835474 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e1a22373-b2b3-4b7c-a4f8-6cb2fba3fced tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:28.836469 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e1a22373-b2b3-4b7c-a4f8-6cb2fba3fced tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:28.841234 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3f442f38-b068-4d18-a33b-fba329d6c99d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:28.842089 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3f442f38-b068-4d18-a33b-fba329d6c99d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:28.844796 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e1a22373-b2b3-4b7c-a4f8-6cb2fba3fced tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:28.845384 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e1a22373-b2b3-4b7c-a4f8-6cb2fba3fced tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:28.846015 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e1a22373-b2b3-4b7c-a4f8-6cb2fba3fced tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:28.847013 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e1a22373-b2b3-4b7c-a4f8-6cb2fba3fced tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:28.847408 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e1a22373-b2b3-4b7c-a4f8-6cb2fba3fced tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:28.847995 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e1a22373-b2b3-4b7c-a4f8-6cb2fba3fced tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:28.849081 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f442f38-b068-4d18-a33b-fba329d6c99d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:28.850476 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f442f38-b068-4d18-a33b-fba329d6c99d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:28.850940 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f442f38-b068-4d18-a33b-fba329d6c99d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:28.851671 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f442f38-b068-4d18-a33b-fba329d6c99d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:28.852124 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f442f38-b068-4d18-a33b-fba329d6c99d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:28.852546 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f442f38-b068-4d18-a33b-fba329d6c99d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:29.068787 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3f442f38-b068-4d18-a33b-fba329d6c99d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:29.072506 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e1a22373-b2b3-4b7c-a4f8-6cb2fba3fced tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:29.077853 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-3f442f38-b068-4d18-a33b-fba329d6c99d tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.247761 Sep 01 17:40:29.078431 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 253/538] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:28 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:29.080286 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e1a22373-b2b3-4b7c-a4f8-6cb2fba3fced tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1518 microversion: 2.1 time: 0.250206 Sep 01 17:40:29.080840 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 286/539] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:28 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1518 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:29.602079 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d143dc6b-6006-4a39-96cd-056d3233e905 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:29.602675 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d143dc6b-6006-4a39-96cd-056d3233e905 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:29.608969 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d143dc6b-6006-4a39-96cd-056d3233e905 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:29.609440 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d143dc6b-6006-4a39-96cd-056d3233e905 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:29.609898 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d143dc6b-6006-4a39-96cd-056d3233e905 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:29.610574 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d143dc6b-6006-4a39-96cd-056d3233e905 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:29.611020 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d143dc6b-6006-4a39-96cd-056d3233e905 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:29.611434 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d143dc6b-6006-4a39-96cd-056d3233e905 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:29.745375 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d143dc6b-6006-4a39-96cd-056d3233e905 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:29.753907 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d143dc6b-6006-4a39-96cd-056d3233e905 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:29.756143 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d143dc6b-6006-4a39-96cd-056d3233e905 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:29.757273 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d143dc6b-6006-4a39-96cd-056d3233e905 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.159173 Sep 01 17:40:29.757864 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 254/540] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:29 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:29.809938 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3b9515b2-bb29-4440-ac50-f0961d830dda tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:29.810543 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3b9515b2-bb29-4440-ac50-f0961d830dda tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:29.816977 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3b9515b2-bb29-4440-ac50-f0961d830dda tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:29.818087 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3b9515b2-bb29-4440-ac50-f0961d830dda tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:29.818525 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3b9515b2-bb29-4440-ac50-f0961d830dda tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:29.819220 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3b9515b2-bb29-4440-ac50-f0961d830dda tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:29.819669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3b9515b2-bb29-4440-ac50-f0961d830dda tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:29.820095 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3b9515b2-bb29-4440-ac50-f0961d830dda tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:29.948030 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3b9515b2-bb29-4440-ac50-f0961d830dda tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:29.955629 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3b9515b2-bb29-4440-ac50-f0961d830dda tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.149756 Sep 01 17:40:29.956202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 287/541] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:29 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:30.100584 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-14d932d9-ee17-45e6-83a8-d13edfd6a77b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:30.101182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2103eda7-fa29-42ee-9048-adcfc5fb1653 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:30.101299 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-14d932d9-ee17-45e6-83a8-d13edfd6a77b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:30.101758 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2103eda7-fa29-42ee-9048-adcfc5fb1653 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:30.107788 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2103eda7-fa29-42ee-9048-adcfc5fb1653 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:30.108281 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2103eda7-fa29-42ee-9048-adcfc5fb1653 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:30.108515 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14d932d9-ee17-45e6-83a8-d13edfd6a77b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:30.108710 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2103eda7-fa29-42ee-9048-adcfc5fb1653 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:30.109249 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14d932d9-ee17-45e6-83a8-d13edfd6a77b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:30.109421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2103eda7-fa29-42ee-9048-adcfc5fb1653 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:30.109886 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14d932d9-ee17-45e6-83a8-d13edfd6a77b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:30.110044 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2103eda7-fa29-42ee-9048-adcfc5fb1653 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:30.110305 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2103eda7-fa29-42ee-9048-adcfc5fb1653 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:30.110917 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14d932d9-ee17-45e6-83a8-d13edfd6a77b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:30.111638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14d932d9-ee17-45e6-83a8-d13edfd6a77b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:30.112131 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14d932d9-ee17-45e6-83a8-d13edfd6a77b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:30.645122 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2103eda7-fa29-42ee-9048-adcfc5fb1653 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:30.653278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2103eda7-fa29-42ee-9048-adcfc5fb1653 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1518 microversion: 2.1 time: 0.555855 Sep 01 17:40:30.665683 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 288/542] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:30 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1518 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:30.668671 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-14d932d9-ee17-45e6-83a8-d13edfd6a77b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:30.679528 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-14d932d9-ee17-45e6-83a8-d13edfd6a77b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.582745 Sep 01 17:40:30.680131 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 255/543] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:30 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:30.784078 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f48e16f9-b469-4542-b548-0a8be3112e73 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:30.784683 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f48e16f9-b469-4542-b548-0a8be3112e73 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:30.795693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f48e16f9-b469-4542-b548-0a8be3112e73 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:30.796404 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f48e16f9-b469-4542-b548-0a8be3112e73 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:30.797205 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f48e16f9-b469-4542-b548-0a8be3112e73 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:30.798366 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f48e16f9-b469-4542-b548-0a8be3112e73 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:30.799154 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f48e16f9-b469-4542-b548-0a8be3112e73 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:30.799911 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f48e16f9-b469-4542-b548-0a8be3112e73 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:30.977816 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-434ed817-367e-4387-8d93-a61343ef6cf2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:30.978682 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-434ed817-367e-4387-8d93-a61343ef6cf2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:30.984948 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-434ed817-367e-4387-8d93-a61343ef6cf2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:30.985478 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-434ed817-367e-4387-8d93-a61343ef6cf2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:30.985980 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-434ed817-367e-4387-8d93-a61343ef6cf2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:30.986800 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-434ed817-367e-4387-8d93-a61343ef6cf2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:30.987262 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-434ed817-367e-4387-8d93-a61343ef6cf2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:30.987691 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-434ed817-367e-4387-8d93-a61343ef6cf2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:31.200090 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f48e16f9-b469-4542-b548-0a8be3112e73 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:31.209170 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f48e16f9-b469-4542-b548-0a8be3112e73 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:31.210670 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f48e16f9-b469-4542-b548-0a8be3112e73 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:31.211800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f48e16f9-b469-4542-b548-0a8be3112e73 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.434922 Sep 01 17:40:31.222430 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 289/544] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:30 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:31.308479 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-434ed817-367e-4387-8d93-a61343ef6cf2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:31.320958 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-434ed817-367e-4387-8d93-a61343ef6cf2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.347981 Sep 01 17:40:31.321680 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 256/545] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:30 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:31.540538 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-f9b673b5-8dfd-437a-b4f7-59db0f311f36 req-da678fb7-3280-423c-8832-4183c1c688a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ef555c-0fec-491a-bc16-4e60b61a338d", "name": "network-vif-deleted", "tag": "e565bb9b-eb5c-4447-9314-4a49199b5e4e"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:31.549926 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-f9b673b5-8dfd-437a-b4f7-59db0f311f36 req-da678fb7-3280-423c-8832-4183c1c688a9 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:31.550407 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-f9b673b5-8dfd-437a-b4f7-59db0f311f36 req-da678fb7-3280-423c-8832-4183c1c688a9 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:31.550832 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-f9b673b5-8dfd-437a-b4f7-59db0f311f36 req-da678fb7-3280-423c-8832-4183c1c688a9 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:31.562474 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-f9b673b5-8dfd-437a-b4f7-59db0f311f36 req-da678fb7-3280-423c-8832-4183c1c688a9 service nova] Creating event network-vif-deleted:e565bb9b-eb5c-4447-9314-4a49199b5e4e for instance 46ef555c-0fec-491a-bc16-4e60b61a338d on hv-cinder-83976 Sep 01 17:40:31.567415 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-f9b673b5-8dfd-437a-b4f7-59db0f311f36 req-da678fb7-3280-423c-8832-4183c1c688a9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031401 Sep 01 17:40:31.568071 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 290/546] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:31.676329 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-361c7c3e-ef1e-41ff-9f07-e40c0eb0ca8e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:31.677016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-361c7c3e-ef1e-41ff-9f07-e40c0eb0ca8e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:31.683631 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-361c7c3e-ef1e-41ff-9f07-e40c0eb0ca8e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:31.684118 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-361c7c3e-ef1e-41ff-9f07-e40c0eb0ca8e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:31.684554 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-361c7c3e-ef1e-41ff-9f07-e40c0eb0ca8e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:31.685261 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-361c7c3e-ef1e-41ff-9f07-e40c0eb0ca8e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:31.685760 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-361c7c3e-ef1e-41ff-9f07-e40c0eb0ca8e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:31.686187 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-361c7c3e-ef1e-41ff-9f07-e40c0eb0ca8e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:31.702057 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5013517d-b9af-43c1-b72e-4a4feaca132e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:31.702759 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5013517d-b9af-43c1-b72e-4a4feaca132e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:31.709760 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5013517d-b9af-43c1-b72e-4a4feaca132e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:31.710281 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5013517d-b9af-43c1-b72e-4a4feaca132e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:31.710773 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5013517d-b9af-43c1-b72e-4a4feaca132e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:31.711480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5013517d-b9af-43c1-b72e-4a4feaca132e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:31.711967 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5013517d-b9af-43c1-b72e-4a4feaca132e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:31.712424 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5013517d-b9af-43c1-b72e-4a4feaca132e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:31.759487 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-361c7c3e-ef1e-41ff-9f07-e40c0eb0ca8e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:31.767452 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-361c7c3e-ef1e-41ff-9f07-e40c0eb0ca8e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1476 microversion: 2.1 time: 0.094955 Sep 01 17:40:31.768036 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 257/547] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:31 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1476 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:31.854154 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5013517d-b9af-43c1-b72e-4a4feaca132e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:31.862356 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5013517d-b9af-43c1-b72e-4a4feaca132e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.164654 Sep 01 17:40:31.862907 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 291/548] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:31 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:32.234623 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-53710b68-d2c4-49c1-bbd4-2cef21064543 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:32.235238 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-53710b68-d2c4-49c1-bbd4-2cef21064543 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:32.248362 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53710b68-d2c4-49c1-bbd4-2cef21064543 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:32.248921 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53710b68-d2c4-49c1-bbd4-2cef21064543 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:32.249281 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53710b68-d2c4-49c1-bbd4-2cef21064543 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:32.250189 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53710b68-d2c4-49c1-bbd4-2cef21064543 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:32.250632 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53710b68-d2c4-49c1-bbd4-2cef21064543 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:32.251059 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-53710b68-d2c4-49c1-bbd4-2cef21064543 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:32.342746 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3bfc7218-fbfb-424f-94a8-d8e02b0b018a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:32.343565 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3bfc7218-fbfb-424f-94a8-d8e02b0b018a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:32.351746 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3bfc7218-fbfb-424f-94a8-d8e02b0b018a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:32.352234 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3bfc7218-fbfb-424f-94a8-d8e02b0b018a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:32.352907 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3bfc7218-fbfb-424f-94a8-d8e02b0b018a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:32.353697 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3bfc7218-fbfb-424f-94a8-d8e02b0b018a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:32.354396 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3bfc7218-fbfb-424f-94a8-d8e02b0b018a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:32.354742 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3bfc7218-fbfb-424f-94a8-d8e02b0b018a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:32.419383 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-53710b68-d2c4-49c1-bbd4-2cef21064543 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:32.434149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-53710b68-d2c4-49c1-bbd4-2cef21064543 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:32.437179 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-53710b68-d2c4-49c1-bbd4-2cef21064543 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:32.439517 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-53710b68-d2c4-49c1-bbd4-2cef21064543 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.208452 Sep 01 17:40:32.441853 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 258/549] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:32 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:32.514847 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3bfc7218-fbfb-424f-94a8-d8e02b0b018a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:32.523868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3bfc7218-fbfb-424f-94a8-d8e02b0b018a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.184934 Sep 01 17:40:32.524461 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 292/550] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:32 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:32.789763 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:32.790371 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:32.797021 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:32.797504 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:32.797966 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:32.798687 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:32.799197 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:32.799618 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:32.834177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:32.834657 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:32.835089 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:32.835533 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lazy-loading 'fault' on Instance uuid 46ef555c-0fec-491a-bc16-4e60b61a338d {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:40:32.878698 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:32.884335 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e2deef0a-c922-4a94-81a2-cfd058d2d0d3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:32.884942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e2deef0a-c922-4a94-81a2-cfd058d2d0d3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:32.886797 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-615d6764-2119-466f-a384-6883ec28819b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1313 microversion: 2.1 time: 0.102402 Sep 01 17:40:32.887385 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 259/551] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:32 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1313 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:32.891637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e2deef0a-c922-4a94-81a2-cfd058d2d0d3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:32.897340 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e2deef0a-c922-4a94-81a2-cfd058d2d0d3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:32.897340 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e2deef0a-c922-4a94-81a2-cfd058d2d0d3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:32.897340 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e2deef0a-c922-4a94-81a2-cfd058d2d0d3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:32.897340 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e2deef0a-c922-4a94-81a2-cfd058d2d0d3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:32.897969 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e2deef0a-c922-4a94-81a2-cfd058d2d0d3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:33.029437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e2deef0a-c922-4a94-81a2-cfd058d2d0d3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:33.038727 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e2deef0a-c922-4a94-81a2-cfd058d2d0d3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.158035 Sep 01 17:40:33.039317 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 293/552] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:32 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:33.463644 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cd11f302-0527-4806-90a3-9afc35e90e14 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:33.464717 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-cd11f302-0527-4806-90a3-9afc35e90e14 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:33.471560 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cd11f302-0527-4806-90a3-9afc35e90e14 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:33.472151 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cd11f302-0527-4806-90a3-9afc35e90e14 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:33.472658 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cd11f302-0527-4806-90a3-9afc35e90e14 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:33.474062 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cd11f302-0527-4806-90a3-9afc35e90e14 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:33.474600 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cd11f302-0527-4806-90a3-9afc35e90e14 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:33.475093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cd11f302-0527-4806-90a3-9afc35e90e14 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:33.549090 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-58f13d08-284b-4906-83a3-669ec7bd56ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:33.550401 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-58f13d08-284b-4906-83a3-669ec7bd56ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:33.556933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-58f13d08-284b-4906-83a3-669ec7bd56ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:33.557789 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-58f13d08-284b-4906-83a3-669ec7bd56ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:33.558389 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-58f13d08-284b-4906-83a3-669ec7bd56ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:33.559274 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-58f13d08-284b-4906-83a3-669ec7bd56ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:33.559891 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-58f13d08-284b-4906-83a3-669ec7bd56ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:33.560472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-58f13d08-284b-4906-83a3-669ec7bd56ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:33.652637 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-cd11f302-0527-4806-90a3-9afc35e90e14 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:33.656275 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:33.664776 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-cd11f302-0527-4806-90a3-9afc35e90e14 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:33.666237 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-cd11f302-0527-4806-90a3-9afc35e90e14 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:33.667663 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-cd11f302-0527-4806-90a3-9afc35e90e14 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.207747 Sep 01 17:40:33.667984 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 260/553] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:33 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:33.728736 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-58f13d08-284b-4906-83a3-669ec7bd56ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:33.738789 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-58f13d08-284b-4906-83a3-669ec7bd56ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.194305 Sep 01 17:40:33.740843 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 294/554] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:33 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:33.908690 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:33.909435 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:33.918877 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:33.919369 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:33.919812 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:33.920520 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:33.920977 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:33.921407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:33.956743 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:33.957241 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:33.958298 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:33.958753 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lazy-loading 'fault' on Instance uuid 46ef555c-0fec-491a-bc16-4e60b61a338d {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:40:34.025419 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:34.032436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-49d0cc0e-70f4-4346-8a85-7dcf6a126e2f tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 200 len: 1313 microversion: 2.1 time: 0.127644 Sep 01 17:40:34.032992 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 261/555] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:33 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 1313 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:34.060124 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b0db743b-646f-4d3a-b11f-a3c16eee7109 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:34.060717 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-b0db743b-646f-4d3a-b11f-a3c16eee7109 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:34.067972 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b0db743b-646f-4d3a-b11f-a3c16eee7109 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:34.068733 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b0db743b-646f-4d3a-b11f-a3c16eee7109 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:34.069377 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b0db743b-646f-4d3a-b11f-a3c16eee7109 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:34.070255 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b0db743b-646f-4d3a-b11f-a3c16eee7109 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:34.071195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b0db743b-646f-4d3a-b11f-a3c16eee7109 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:34.071391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b0db743b-646f-4d3a-b11f-a3c16eee7109 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:34.209468 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b0db743b-646f-4d3a-b11f-a3c16eee7109 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:34.217881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-b0db743b-646f-4d3a-b11f-a3c16eee7109 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.161599 Sep 01 17:40:34.218448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 295/556] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:34 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:34.690092 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d2dbd7cd-17b6-4180-9150-ab86d4059588 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:34.690697 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d2dbd7cd-17b6-4180-9150-ab86d4059588 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:34.696965 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d2dbd7cd-17b6-4180-9150-ab86d4059588 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:34.697445 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d2dbd7cd-17b6-4180-9150-ab86d4059588 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:34.697900 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d2dbd7cd-17b6-4180-9150-ab86d4059588 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:34.698586 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d2dbd7cd-17b6-4180-9150-ab86d4059588 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:34.699055 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d2dbd7cd-17b6-4180-9150-ab86d4059588 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:34.699472 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d2dbd7cd-17b6-4180-9150-ab86d4059588 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:34.760771 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-23076aaf-bcc8-4552-9cee-4d101d74cfa9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:34.761387 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-23076aaf-bcc8-4552-9cee-4d101d74cfa9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:34.767413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-23076aaf-bcc8-4552-9cee-4d101d74cfa9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:34.767893 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-23076aaf-bcc8-4552-9cee-4d101d74cfa9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:34.768332 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-23076aaf-bcc8-4552-9cee-4d101d74cfa9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:34.769146 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-23076aaf-bcc8-4552-9cee-4d101d74cfa9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:34.769627 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-23076aaf-bcc8-4552-9cee-4d101d74cfa9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:34.770053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-23076aaf-bcc8-4552-9cee-4d101d74cfa9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:34.877948 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d2dbd7cd-17b6-4180-9150-ab86d4059588 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:34.886983 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d2dbd7cd-17b6-4180-9150-ab86d4059588 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:34.888519 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d2dbd7cd-17b6-4180-9150-ab86d4059588 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:34.889818 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d2dbd7cd-17b6-4180-9150-ab86d4059588 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.203625 Sep 01 17:40:34.890458 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 262/557] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:34 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:34.922974 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-23076aaf-bcc8-4552-9cee-4d101d74cfa9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:34.930604 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-23076aaf-bcc8-4552-9cee-4d101d74cfa9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.173676 Sep 01 17:40:34.931171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 296/558] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:34 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:35.055286 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c04209c9-1001-4e4a-bf16-fd474308bb47 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:35.055889 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c04209c9-1001-4e4a-bf16-fd474308bb47 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 46ef555c-0fec-491a-bc16-4e60b61a338d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:35.062693 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c04209c9-1001-4e4a-bf16-fd474308bb47 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:35.063176 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c04209c9-1001-4e4a-bf16-fd474308bb47 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:35.063672 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c04209c9-1001-4e4a-bf16-fd474308bb47 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:35.064443 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c04209c9-1001-4e4a-bf16-fd474308bb47 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:35.064921 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c04209c9-1001-4e4a-bf16-fd474308bb47 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:35.065354 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c04209c9-1001-4e4a-bf16-fd474308bb47 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:35.080953 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-c04209c9-1001-4e4a-bf16-fd474308bb47 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] HTTP exception thrown: Instance 46ef555c-0fec-491a-bc16-4e60b61a338d could not be found. Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c04209c9-1001-4e4a-bf16-fd474308bb47 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Request method failure captured: Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d HTTP/1.1 Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO4Rb6B2-RuOkdTUqAqiQwRQIomnkkU5U4y_uyW-pUBfsoXlsrDSxxz4G-eKNCSdrtPfGmzxJ9e9Hr8IHIPvPbILuleY6ZIDQq7ENZPoi8u5GHL1HkN6lNllklNiwtkrfkQQNaiSqPwWTc1X53GkqqnD1ZYbAjvHGdEbmAJ7mlTlcKI Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 6695ac82241740f5ac5f73b4bcdac5f5 Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-VolumesSnapshotTestJSON-572627331 Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:40:35.083532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:40:35.084981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/6695ac82241740f5ac5f73b4bcdac5f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/6695ac82241740f5ac5f73b4bcdac5f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_6695ac82241740f5ac5f73b4bcdac5f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/6695ac82241740f5ac5f73b4bcdac5f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:40:35.084981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-VolumesSnapshotTestJSON-572627331 Sep 01 17:40:35.084981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 6695ac82241740f5ac5f73b4bcdac5f5 Sep 01 17:40:35.084981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-572627331 Sep 01 17:40:35.084981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-VolumesSnapshotTestJSON-572627331-project Sep 01 17:40:35.084981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:40:35.084981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:40:35.084981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: 66366eb7b7044786b23d08676c14670f Sep 01 17:40:35.084981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-VolumesSnapshotTestJSON-572627331-project Sep 01 17:40:35.084981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:40:35.084981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 46ef555c-0fec-491a-bc16-4e60b61a338d could not be found. Sep 01 17:40:35.084981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '46ef555c-0fec-491a-bc16-4e60b61a338d'} Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46ef555c-0fec-491a-bc16-4e60b61a338d could not be found. Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:40:35.085858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46ef555c-0fec-491a-bc16-4e60b61a338d could not be found. Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46ef555c-0fec-491a-bc16-4e60b61a338d could not be found. Sep 01 17:40:35.087125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:40:35.088295 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c04209c9-1001-4e4a-bf16-fd474308bb47 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Returning 404 to user: Instance 46ef555c-0fec-491a-bc16-4e60b61a338d could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:40:35.088295 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c04209c9-1001-4e4a-bf16-fd474308bb47 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d" status: 404 len: 111 microversion: 2.1 time: 0.034711 Sep 01 17:40:35.088295 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 263/559] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:35 2022] GET /compute/v2.1/servers/46ef555c-0fec-491a-bc16-4e60b61a338d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:40:35.244386 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-27e16bee-4b26-4290-ad0e-b4745e035847 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:35.245266 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-27e16bee-4b26-4290-ad0e-b4745e035847 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:35.252919 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27e16bee-4b26-4290-ad0e-b4745e035847 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:35.253789 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27e16bee-4b26-4290-ad0e-b4745e035847 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:35.254786 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27e16bee-4b26-4290-ad0e-b4745e035847 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:35.255918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27e16bee-4b26-4290-ad0e-b4745e035847 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:35.256650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27e16bee-4b26-4290-ad0e-b4745e035847 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:35.257370 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27e16bee-4b26-4290-ad0e-b4745e035847 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:35.424853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-27e16bee-4b26-4290-ad0e-b4745e035847 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:35.434119 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-27e16bee-4b26-4290-ad0e-b4745e035847 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.195374 Sep 01 17:40:35.434701 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 297/560] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:35 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:35.912463 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f7763eb2-4bdd-4b3d-bbdd-86c18430c406 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:35.913056 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f7763eb2-4bdd-4b3d-bbdd-86c18430c406 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:35.919377 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f7763eb2-4bdd-4b3d-bbdd-86c18430c406 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:35.919853 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f7763eb2-4bdd-4b3d-bbdd-86c18430c406 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:35.920280 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f7763eb2-4bdd-4b3d-bbdd-86c18430c406 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:35.920964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f7763eb2-4bdd-4b3d-bbdd-86c18430c406 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:35.921407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f7763eb2-4bdd-4b3d-bbdd-86c18430c406 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:35.921859 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f7763eb2-4bdd-4b3d-bbdd-86c18430c406 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:35.951382 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-028b37f2-8b58-4341-a2f7-81111056552c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:35.951987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-028b37f2-8b58-4341-a2f7-81111056552c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:35.958635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-028b37f2-8b58-4341-a2f7-81111056552c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:35.959116 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-028b37f2-8b58-4341-a2f7-81111056552c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:35.959551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-028b37f2-8b58-4341-a2f7-81111056552c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:35.960253 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-028b37f2-8b58-4341-a2f7-81111056552c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:35.960702 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-028b37f2-8b58-4341-a2f7-81111056552c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:35.961123 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-028b37f2-8b58-4341-a2f7-81111056552c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:36.116076 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f7763eb2-4bdd-4b3d-bbdd-86c18430c406 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:36.124403 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f7763eb2-4bdd-4b3d-bbdd-86c18430c406 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:36.125860 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f7763eb2-4bdd-4b3d-bbdd-86c18430c406 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:36.127029 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f7763eb2-4bdd-4b3d-bbdd-86c18430c406 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.218545 Sep 01 17:40:36.127582 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 264/561] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:35 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:36.146772 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-028b37f2-8b58-4341-a2f7-81111056552c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:36.154786 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-028b37f2-8b58-4341-a2f7-81111056552c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.207219 Sep 01 17:40:36.155367 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 298/562] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:35 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:36.455536 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c727ab40-45c1-4543-a3b9-1fce61dd5e85 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:36.456139 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c727ab40-45c1-4543-a3b9-1fce61dd5e85 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:36.462636 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c727ab40-45c1-4543-a3b9-1fce61dd5e85 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:36.463120 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c727ab40-45c1-4543-a3b9-1fce61dd5e85 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:36.463555 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c727ab40-45c1-4543-a3b9-1fce61dd5e85 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:36.464239 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c727ab40-45c1-4543-a3b9-1fce61dd5e85 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:36.464685 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c727ab40-45c1-4543-a3b9-1fce61dd5e85 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:36.465106 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c727ab40-45c1-4543-a3b9-1fce61dd5e85 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:36.594439 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c727ab40-45c1-4543-a3b9-1fce61dd5e85 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:36.603090 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c727ab40-45c1-4543-a3b9-1fce61dd5e85 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.151450 Sep 01 17:40:36.603656 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 265/563] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:36 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:37.151094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f88e0501-087f-4df6-90f2-18beebcf05dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:37.151671 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f88e0501-087f-4df6-90f2-18beebcf05dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:37.158180 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f88e0501-087f-4df6-90f2-18beebcf05dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:37.158652 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f88e0501-087f-4df6-90f2-18beebcf05dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:37.159080 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f88e0501-087f-4df6-90f2-18beebcf05dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:37.159762 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f88e0501-087f-4df6-90f2-18beebcf05dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:37.160206 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f88e0501-087f-4df6-90f2-18beebcf05dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:37.160617 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f88e0501-087f-4df6-90f2-18beebcf05dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:37.176198 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-fadbe883-33aa-4a4d-b08e-c505733d625c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:37.176856 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-fadbe883-33aa-4a4d-b08e-c505733d625c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:37.183120 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fadbe883-33aa-4a4d-b08e-c505733d625c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:37.183641 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fadbe883-33aa-4a4d-b08e-c505733d625c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:37.184076 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fadbe883-33aa-4a4d-b08e-c505733d625c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:37.184886 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fadbe883-33aa-4a4d-b08e-c505733d625c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:37.186384 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fadbe883-33aa-4a4d-b08e-c505733d625c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:37.186823 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fadbe883-33aa-4a4d-b08e-c505733d625c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:37.367347 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f88e0501-087f-4df6-90f2-18beebcf05dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:37.377071 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f88e0501-087f-4df6-90f2-18beebcf05dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:37.377216 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-fadbe883-33aa-4a4d-b08e-c505733d625c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:37.378576 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f88e0501-087f-4df6-90f2-18beebcf05dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:37.381114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f88e0501-087f-4df6-90f2-18beebcf05dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.233490 Sep 01 17:40:37.393601 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 299/564] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:37 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:37.393840 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-fadbe883-33aa-4a4d-b08e-c505733d625c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.213541 Sep 01 17:40:37.394019 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 266/565] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:37 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:37.624875 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ca00b336-d8ad-4689-adea-f1b68f43783f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:37.625524 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ca00b336-d8ad-4689-adea-f1b68f43783f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:37.632826 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ca00b336-d8ad-4689-adea-f1b68f43783f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:37.633312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ca00b336-d8ad-4689-adea-f1b68f43783f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:37.633793 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ca00b336-d8ad-4689-adea-f1b68f43783f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:37.634491 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ca00b336-d8ad-4689-adea-f1b68f43783f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:37.634933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ca00b336-d8ad-4689-adea-f1b68f43783f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:37.635348 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ca00b336-d8ad-4689-adea-f1b68f43783f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:37.777910 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ca00b336-d8ad-4689-adea-f1b68f43783f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:37.786358 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ca00b336-d8ad-4689-adea-f1b68f43783f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.165148 Sep 01 17:40:37.786929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 300/566] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:37 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:38.407465 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5860232b-d689-4708-a2ef-19e9a9651ce5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:38.408114 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-aa1a6b06-46e5-4163-b7bc-168b5714bfc8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:38.408114 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-aa1a6b06-46e5-4163-b7bc-168b5714bfc8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:38.408561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5860232b-d689-4708-a2ef-19e9a9651ce5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:38.414962 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa1a6b06-46e5-4163-b7bc-168b5714bfc8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:38.415579 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa1a6b06-46e5-4163-b7bc-168b5714bfc8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:38.415817 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5860232b-d689-4708-a2ef-19e9a9651ce5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:38.415924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa1a6b06-46e5-4163-b7bc-168b5714bfc8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:38.416042 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5860232b-d689-4708-a2ef-19e9a9651ce5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:38.416357 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5860232b-d689-4708-a2ef-19e9a9651ce5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:38.416588 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa1a6b06-46e5-4163-b7bc-168b5714bfc8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:38.417044 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa1a6b06-46e5-4163-b7bc-168b5714bfc8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:38.417173 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5860232b-d689-4708-a2ef-19e9a9651ce5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:38.417469 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aa1a6b06-46e5-4163-b7bc-168b5714bfc8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:38.417605 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5860232b-d689-4708-a2ef-19e9a9651ce5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:38.417908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5860232b-d689-4708-a2ef-19e9a9651ce5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:38.630680 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5860232b-d689-4708-a2ef-19e9a9651ce5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:38.639448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5860232b-d689-4708-a2ef-19e9a9651ce5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.235775 Sep 01 17:40:38.639806 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-aa1a6b06-46e5-4163-b7bc-168b5714bfc8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:38.640038 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 301/567] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:38 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:38.649933 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-aa1a6b06-46e5-4163-b7bc-168b5714bfc8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:38.655189 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-aa1a6b06-46e5-4163-b7bc-168b5714bfc8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:38.656600 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-aa1a6b06-46e5-4163-b7bc-168b5714bfc8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.253039 Sep 01 17:40:38.657843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 267/568] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:38 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:38.808896 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f5e0fc28-668a-4c43-950a-f2e423a1d4a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:38.809494 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f5e0fc28-668a-4c43-950a-f2e423a1d4a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:38.815661 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f5e0fc28-668a-4c43-950a-f2e423a1d4a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:38.816150 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f5e0fc28-668a-4c43-950a-f2e423a1d4a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:38.816621 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f5e0fc28-668a-4c43-950a-f2e423a1d4a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:38.817777 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f5e0fc28-668a-4c43-950a-f2e423a1d4a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:38.817954 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f5e0fc28-668a-4c43-950a-f2e423a1d4a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:38.818381 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f5e0fc28-668a-4c43-950a-f2e423a1d4a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:38.835384 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:38.957648 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f5e0fc28-668a-4c43-950a-f2e423a1d4a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:38.965966 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f5e0fc28-668a-4c43-950a-f2e423a1d4a5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.160950 Sep 01 17:40:38.966533 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 302/569] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:38 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:39.663952 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-39f34121-3f60-4299-8c5d-9dd44d562e61 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:39.665267 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-39f34121-3f60-4299-8c5d-9dd44d562e61 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:39.675037 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39f34121-3f60-4299-8c5d-9dd44d562e61 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:39.675899 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39f34121-3f60-4299-8c5d-9dd44d562e61 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:39.676673 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39f34121-3f60-4299-8c5d-9dd44d562e61 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:39.678146 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39f34121-3f60-4299-8c5d-9dd44d562e61 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:39.678876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39f34121-3f60-4299-8c5d-9dd44d562e61 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:39.679580 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39f34121-3f60-4299-8c5d-9dd44d562e61 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:39.693543 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f37af758-fc2e-465f-97c4-fe193fb1dd9a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:39.695156 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f37af758-fc2e-465f-97c4-fe193fb1dd9a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:39.717021 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f37af758-fc2e-465f-97c4-fe193fb1dd9a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:39.717410 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f37af758-fc2e-465f-97c4-fe193fb1dd9a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:39.717870 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f37af758-fc2e-465f-97c4-fe193fb1dd9a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:39.718773 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f37af758-fc2e-465f-97c4-fe193fb1dd9a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:39.719225 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f37af758-fc2e-465f-97c4-fe193fb1dd9a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:39.719643 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f37af758-fc2e-465f-97c4-fe193fb1dd9a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:39.940501 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-39f34121-3f60-4299-8c5d-9dd44d562e61 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:39.946196 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f37af758-fc2e-465f-97c4-fe193fb1dd9a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:39.951768 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-39f34121-3f60-4299-8c5d-9dd44d562e61 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.292310 Sep 01 17:40:39.952681 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 268/570] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:39 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:39.960260 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ee7882b3-4853-41d4-bbda-fc8f56346954 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:39.961039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ee7882b3-4853-41d4-bbda-fc8f56346954 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:39.969486 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ee7882b3-4853-41d4-bbda-fc8f56346954 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:39.970033 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ee7882b3-4853-41d4-bbda-fc8f56346954 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:39.970498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ee7882b3-4853-41d4-bbda-fc8f56346954 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:39.971168 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ee7882b3-4853-41d4-bbda-fc8f56346954 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:39.971616 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ee7882b3-4853-41d4-bbda-fc8f56346954 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:39.972039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ee7882b3-4853-41d4-bbda-fc8f56346954 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:39.976132 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f37af758-fc2e-465f-97c4-fe193fb1dd9a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:39.984605 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f37af758-fc2e-465f-97c4-fe193fb1dd9a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:39.986708 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f37af758-fc2e-465f-97c4-fe193fb1dd9a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.299010 Sep 01 17:40:39.987466 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 303/571] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:39 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:39.993966 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d4183160-a356-4adf-8fc8-e50c62159d48 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:39.994825 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d4183160-a356-4adf-8fc8-e50c62159d48 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:40.001421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d4183160-a356-4adf-8fc8-e50c62159d48 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:40.002153 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d4183160-a356-4adf-8fc8-e50c62159d48 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:40.002793 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d4183160-a356-4adf-8fc8-e50c62159d48 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:40.003736 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d4183160-a356-4adf-8fc8-e50c62159d48 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:40.004195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d4183160-a356-4adf-8fc8-e50c62159d48 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:40.005218 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d4183160-a356-4adf-8fc8-e50c62159d48 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:40.181036 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ee7882b3-4853-41d4-bbda-fc8f56346954 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:40.189908 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ee7882b3-4853-41d4-bbda-fc8f56346954 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1598 microversion: 2.1 time: 0.236018 Sep 01 17:40:40.190494 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 269/572] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:39 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1598 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:40.211919 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d4183160-a356-4adf-8fc8-e50c62159d48 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:40.224568 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d4183160-a356-4adf-8fc8-e50c62159d48 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.235104 Sep 01 17:40:40.224977 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 304/573] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:39 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:40.975157 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-249d39e6-a1af-410a-91ba-26c452fe66bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:40.976988 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-249d39e6-a1af-410a-91ba-26c452fe66bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:40.990028 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-249d39e6-a1af-410a-91ba-26c452fe66bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:40.990530 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-249d39e6-a1af-410a-91ba-26c452fe66bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:40.990971 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-249d39e6-a1af-410a-91ba-26c452fe66bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:40.991854 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-249d39e6-a1af-410a-91ba-26c452fe66bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:40.992381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-249d39e6-a1af-410a-91ba-26c452fe66bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:40.992849 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-249d39e6-a1af-410a-91ba-26c452fe66bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:41.011436 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6204ed48-bd46-43de-95d6-77a26b31cbda tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:41.012237 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6204ed48-bd46-43de-95d6-77a26b31cbda tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:41.020837 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6204ed48-bd46-43de-95d6-77a26b31cbda tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:41.021669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6204ed48-bd46-43de-95d6-77a26b31cbda tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:41.022329 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6204ed48-bd46-43de-95d6-77a26b31cbda tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:41.023458 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6204ed48-bd46-43de-95d6-77a26b31cbda tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:41.024122 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6204ed48-bd46-43de-95d6-77a26b31cbda tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:41.024945 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6204ed48-bd46-43de-95d6-77a26b31cbda tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:41.212129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-249d39e6-a1af-410a-91ba-26c452fe66bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:41.221764 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-249d39e6-a1af-410a-91ba-26c452fe66bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.251601 Sep 01 17:40:41.234282 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 270/574] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:40 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:41.244376 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-bda6ff10-9119-4b60-b5b8-5e46bac39b6b req-6068602c-25c0-4aed-a348-1da3e64d57b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e176cb-aabb-40b5-a79d-acf5d061b2da", "name": "network-vif-plugged", "status": "completed", "tag": "5be3ac5e-b565-42ad-abf6-c17408c0347c"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:41.245192 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-6204ed48-bd46-43de-95d6-77a26b31cbda tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:41.256891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-bda6ff10-9119-4b60-b5b8-5e46bac39b6b req-6068602c-25c0-4aed-a348-1da3e64d57b1 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:41.257189 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-6204ed48-bd46-43de-95d6-77a26b31cbda tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:41.257371 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-bda6ff10-9119-4b60-b5b8-5e46bac39b6b req-6068602c-25c0-4aed-a348-1da3e64d57b1 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:41.257849 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-bda6ff10-9119-4b60-b5b8-5e46bac39b6b req-6068602c-25c0-4aed-a348-1da3e64d57b1 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:41.259140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-6204ed48-bd46-43de-95d6-77a26b31cbda tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:41.260359 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-6204ed48-bd46-43de-95d6-77a26b31cbda tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.253005 Sep 01 17:40:41.261313 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 305/575] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:41 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:41.266318 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0f7e0c43-60c7-420e-a8ca-b3d2e8fb99bb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:41.266930 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0f7e0c43-60c7-420e-a8ca-b3d2e8fb99bb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:41.271752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-bda6ff10-9119-4b60-b5b8-5e46bac39b6b req-6068602c-25c0-4aed-a348-1da3e64d57b1 service nova] Creating event network-vif-plugged:5be3ac5e-b565-42ad-abf6-c17408c0347c for instance 92e176cb-aabb-40b5-a79d-acf5d061b2da on hv-cinder-83976 Sep 01 17:40:41.274951 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f7e0c43-60c7-420e-a8ca-b3d2e8fb99bb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:41.275681 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f7e0c43-60c7-420e-a8ca-b3d2e8fb99bb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:41.276118 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f7e0c43-60c7-420e-a8ca-b3d2e8fb99bb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:41.277184 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f7e0c43-60c7-420e-a8ca-b3d2e8fb99bb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:41.277716 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f7e0c43-60c7-420e-a8ca-b3d2e8fb99bb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:41.277835 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-bda6ff10-9119-4b60-b5b8-5e46bac39b6b req-6068602c-25c0-4aed-a348-1da3e64d57b1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042090 Sep 01 17:40:41.278240 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f7e0c43-60c7-420e-a8ca-b3d2e8fb99bb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:41.278778 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 271/576] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:41.459694 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0f7e0c43-60c7-420e-a8ca-b3d2e8fb99bb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:41.468907 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0f7e0c43-60c7-420e-a8ca-b3d2e8fb99bb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.206387 Sep 01 17:40:41.469813 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 306/577] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:41 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:42.118711 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-a03641d7-a3c4-40a5-8809-980d8304484b req-fd2788d5-f19b-4df7-b608-5e4e25ead19a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c4d577-d281-42b7-b448-d38b39a7ee39", "tag": "43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:42.128555 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-a03641d7-a3c4-40a5-8809-980d8304484b req-fd2788d5-f19b-4df7-b608-5e4e25ead19a service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:42.129020 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-a03641d7-a3c4-40a5-8809-980d8304484b req-fd2788d5-f19b-4df7-b608-5e4e25ead19a service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:42.129694 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-a03641d7-a3c4-40a5-8809-980d8304484b req-fd2788d5-f19b-4df7-b608-5e4e25ead19a service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:42.142149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-a03641d7-a3c4-40a5-8809-980d8304484b req-fd2788d5-f19b-4df7-b608-5e4e25ead19a service nova] Creating event network-changed:43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c for instance 14c4d577-d281-42b7-b448-d38b39a7ee39 on hv-cinder-83976 Sep 01 17:40:42.149483 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-a03641d7-a3c4-40a5-8809-980d8304484b req-fd2788d5-f19b-4df7-b608-5e4e25ead19a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036112 Sep 01 17:40:42.150636 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 272/578] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:42.252083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-132063e6-b192-4248-964c-d63fc2c9f69f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:42.256401 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-132063e6-b192-4248-964c-d63fc2c9f69f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:42.270695 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-132063e6-b192-4248-964c-d63fc2c9f69f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:42.271744 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-132063e6-b192-4248-964c-d63fc2c9f69f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:42.272458 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-132063e6-b192-4248-964c-d63fc2c9f69f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:42.273556 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-132063e6-b192-4248-964c-d63fc2c9f69f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:42.274246 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-132063e6-b192-4248-964c-d63fc2c9f69f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:42.275040 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-132063e6-b192-4248-964c-d63fc2c9f69f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:42.296442 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-adaaa435-9d31-4ded-b851-d97e4139a1a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:42.298136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-adaaa435-9d31-4ded-b851-d97e4139a1a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:42.312958 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-adaaa435-9d31-4ded-b851-d97e4139a1a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:42.314255 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-adaaa435-9d31-4ded-b851-d97e4139a1a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:42.314881 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-adaaa435-9d31-4ded-b851-d97e4139a1a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:42.315771 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-adaaa435-9d31-4ded-b851-d97e4139a1a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:42.316385 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-adaaa435-9d31-4ded-b851-d97e4139a1a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:42.317557 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-adaaa435-9d31-4ded-b851-d97e4139a1a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:42.555600 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-132063e6-b192-4248-964c-d63fc2c9f69f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:42.563455 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-adaaa435-9d31-4ded-b851-d97e4139a1a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:42.571078 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-132063e6-b192-4248-964c-d63fc2c9f69f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.329878 Sep 01 17:40:42.571801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 307/579] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:42 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:42.574607 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-adaaa435-9d31-4ded-b851-d97e4139a1a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:42.576298 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-adaaa435-9d31-4ded-b851-d97e4139a1a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:42.577674 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-adaaa435-9d31-4ded-b851-d97e4139a1a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.293688 Sep 01 17:40:42.578421 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 273/580] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:42 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:42.579608 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-275043d2-eacf-461a-9bf6-60e53f98a524 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:42.580368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-275043d2-eacf-461a-9bf6-60e53f98a524 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:42.587703 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-275043d2-eacf-461a-9bf6-60e53f98a524 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:42.588682 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-275043d2-eacf-461a-9bf6-60e53f98a524 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:42.589659 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-275043d2-eacf-461a-9bf6-60e53f98a524 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:42.590669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-275043d2-eacf-461a-9bf6-60e53f98a524 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:42.591449 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-275043d2-eacf-461a-9bf6-60e53f98a524 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:42.591768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-275043d2-eacf-461a-9bf6-60e53f98a524 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:42.786981 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-275043d2-eacf-461a-9bf6-60e53f98a524 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:42.802972 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-275043d2-eacf-461a-9bf6-60e53f98a524 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.228573 Sep 01 17:40:42.813843 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 308/581] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:42 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:43.254268 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-578b5ace-a5e6-4798-b3fb-4b5d258fce19 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1796462018"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:43.254921 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-578b5ace-a5e6-4798-b3fb-4b5d258fce19 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:43.261487 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-578b5ace-a5e6-4798-b3fb-4b5d258fce19 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:43.262007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-578b5ace-a5e6-4798-b3fb-4b5d258fce19 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:43.262442 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-578b5ace-a5e6-4798-b3fb-4b5d258fce19 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:43.263143 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-578b5ace-a5e6-4798-b3fb-4b5d258fce19 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:43.263588 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-578b5ace-a5e6-4798-b3fb-4b5d258fce19 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:43.264007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-578b5ace-a5e6-4798-b3fb-4b5d258fce19 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:43.292995 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-f93b400e-e2d1-4a18-9005-c054c5e7ad12 req-228f88db-5fa1-49f9-9b5e-328f597dcbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc52ad3-09b3-4851-8a50-ad446bd1a75d", "name": "network-vif-plugged", "status": "completed", "tag": "be99e7bf-5f6d-42df-82e3-b77a04fd7684"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:43.312350 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-f93b400e-e2d1-4a18-9005-c054c5e7ad12 req-228f88db-5fa1-49f9-9b5e-328f597dcbc5 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:43.313125 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-f93b400e-e2d1-4a18-9005-c054c5e7ad12 req-228f88db-5fa1-49f9-9b5e-328f597dcbc5 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:43.314648 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-f93b400e-e2d1-4a18-9005-c054c5e7ad12 req-228f88db-5fa1-49f9-9b5e-328f597dcbc5 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:43.328578 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-f93b400e-e2d1-4a18-9005-c054c5e7ad12 req-228f88db-5fa1-49f9-9b5e-328f597dcbc5 service nova] Creating event network-vif-plugged:be99e7bf-5f6d-42df-82e3-b77a04fd7684 for instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d on hv-cinder-83976 Sep 01 17:40:43.335294 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-f93b400e-e2d1-4a18-9005-c054c5e7ad12 req-228f88db-5fa1-49f9-9b5e-328f597dcbc5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045943 Sep 01 17:40:43.335899 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 309/582] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:43.409324 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.network.security_group_api [None req-578b5ace-a5e6-4798-b3fb-4b5d258fce19 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Adding security group 086535f6-ddf1-49b5-a62f-5ae9c8494b96 to port 43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c Sep 01 17:40:43.594174 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-798a4f96-73db-4246-bc92-4435b12f30f8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:43.594971 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-798a4f96-73db-4246-bc92-4435b12f30f8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:43.603381 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-798a4f96-73db-4246-bc92-4435b12f30f8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:43.603875 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-798a4f96-73db-4246-bc92-4435b12f30f8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:43.604307 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-798a4f96-73db-4246-bc92-4435b12f30f8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:43.605015 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-798a4f96-73db-4246-bc92-4435b12f30f8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:43.605823 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-798a4f96-73db-4246-bc92-4435b12f30f8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:43.606276 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-798a4f96-73db-4246-bc92-4435b12f30f8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:43.811201 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-798a4f96-73db-4246-bc92-4435b12f30f8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:43.819926 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-798a4f96-73db-4246-bc92-4435b12f30f8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.229865 Sep 01 17:40:43.820644 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 310/583] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:43 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:43.827439 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-419f57b8-0ae1-4aa7-ad5a-299d669179c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:43.828030 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-419f57b8-0ae1-4aa7-ad5a-299d669179c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:43.835631 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-419f57b8-0ae1-4aa7-ad5a-299d669179c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:43.836113 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-419f57b8-0ae1-4aa7-ad5a-299d669179c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:43.836550 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-419f57b8-0ae1-4aa7-ad5a-299d669179c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:43.837260 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-419f57b8-0ae1-4aa7-ad5a-299d669179c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:43.837738 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-419f57b8-0ae1-4aa7-ad5a-299d669179c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:43.838157 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-419f57b8-0ae1-4aa7-ad5a-299d669179c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:43.838660 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-578b5ace-a5e6-4798-b3fb-4b5d258fce19 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "POST /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/action" status: 202 len: 0 microversion: 2.1 time: 0.588173 Sep 01 17:40:43.839522 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 274/584] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:40:43 2022] POST /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 17:40:43.844933 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5103954b-a0a6-426e-85f5-dbb9b8a956d6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:43.845716 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5103954b-a0a6-426e-85f5-dbb9b8a956d6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:43.852639 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5103954b-a0a6-426e-85f5-dbb9b8a956d6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:43.853283 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5103954b-a0a6-426e-85f5-dbb9b8a956d6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:43.853836 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5103954b-a0a6-426e-85f5-dbb9b8a956d6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:43.854654 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5103954b-a0a6-426e-85f5-dbb9b8a956d6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:43.855208 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5103954b-a0a6-426e-85f5-dbb9b8a956d6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:43.855737 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5103954b-a0a6-426e-85f5-dbb9b8a956d6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:44.160710 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-419f57b8-0ae1-4aa7-ad5a-299d669179c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:44.174925 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5103954b-a0a6-426e-85f5-dbb9b8a956d6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:44.177251 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-419f57b8-0ae1-4aa7-ad5a-299d669179c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:44.178929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-419f57b8-0ae1-4aa7-ad5a-299d669179c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:44.180213 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-419f57b8-0ae1-4aa7-ad5a-299d669179c8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.358526 Sep 01 17:40:44.181269 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 311/585] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:43 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:44.185196 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5103954b-a0a6-426e-85f5-dbb9b8a956d6 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.344160 Sep 01 17:40:44.186175 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 275/586] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:43 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:44.188856 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-52fc06d0-4d2a-4453-b1e1-5cf063390084 req-aa3fafbb-194a-4952-8551-febf2f9bd866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c4d577-d281-42b7-b448-d38b39a7ee39", "tag": "43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:44.191547 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8ad9882f-b978-413b-b1f5-159f2255787c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:44.195098 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8ad9882f-b978-413b-b1f5-159f2255787c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:44.202327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ad9882f-b978-413b-b1f5-159f2255787c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:44.202962 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ad9882f-b978-413b-b1f5-159f2255787c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:44.203397 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ad9882f-b978-413b-b1f5-159f2255787c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:44.203830 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-52fc06d0-4d2a-4453-b1e1-5cf063390084 req-aa3fafbb-194a-4952-8551-febf2f9bd866 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:44.204085 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ad9882f-b978-413b-b1f5-159f2255787c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:44.204448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-52fc06d0-4d2a-4453-b1e1-5cf063390084 req-aa3fafbb-194a-4952-8551-febf2f9bd866 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:44.204562 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ad9882f-b978-413b-b1f5-159f2255787c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:44.205011 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-52fc06d0-4d2a-4453-b1e1-5cf063390084 req-aa3fafbb-194a-4952-8551-febf2f9bd866 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:44.205138 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ad9882f-b978-413b-b1f5-159f2255787c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:44.217613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-52fc06d0-4d2a-4453-b1e1-5cf063390084 req-aa3fafbb-194a-4952-8551-febf2f9bd866 service nova] Creating event network-changed:43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c for instance 14c4d577-d281-42b7-b448-d38b39a7ee39 on hv-cinder-83976 Sep 01 17:40:44.222919 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-52fc06d0-4d2a-4453-b1e1-5cf063390084 req-aa3fafbb-194a-4952-8551-febf2f9bd866 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038872 Sep 01 17:40:44.223867 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 312/587] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:44.352356 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8ad9882f-b978-413b-b1f5-159f2255787c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:44.361103 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8ad9882f-b978-413b-b1f5-159f2255787c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1645 microversion: 2.1 time: 0.173772 Sep 01 17:40:44.361696 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 276/588] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:44 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1645 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:44.841954 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ac55d894-a92b-4eda-9f3f-d12033b02437 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:44.842676 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ac55d894-a92b-4eda-9f3f-d12033b02437 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:44.849950 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ac55d894-a92b-4eda-9f3f-d12033b02437 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:44.850529 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ac55d894-a92b-4eda-9f3f-d12033b02437 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:44.851029 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ac55d894-a92b-4eda-9f3f-d12033b02437 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:44.851802 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ac55d894-a92b-4eda-9f3f-d12033b02437 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:44.852255 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ac55d894-a92b-4eda-9f3f-d12033b02437 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:44.852672 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ac55d894-a92b-4eda-9f3f-d12033b02437 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:45.162738 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ac55d894-a92b-4eda-9f3f-d12033b02437 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:45.171520 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ac55d894-a92b-4eda-9f3f-d12033b02437 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1367 microversion: 2.1 time: 0.334313 Sep 01 17:40:45.172134 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 313/589] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:44 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:45.208251 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-93259d35-0971-4a00-b24b-0265152155fe tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:45.209271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-93259d35-0971-4a00-b24b-0265152155fe tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:45.209696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f0511021-0aff-4d45-b86d-0c6281109e4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:45.210469 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f0511021-0aff-4d45-b86d-0c6281109e4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:45.217275 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f0511021-0aff-4d45-b86d-0c6281109e4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:45.217958 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f0511021-0aff-4d45-b86d-0c6281109e4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:45.218459 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f0511021-0aff-4d45-b86d-0c6281109e4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:45.219310 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-93259d35-0971-4a00-b24b-0265152155fe tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:45.219525 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f0511021-0aff-4d45-b86d-0c6281109e4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:45.219979 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-93259d35-0971-4a00-b24b-0265152155fe tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:45.220264 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f0511021-0aff-4d45-b86d-0c6281109e4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:45.220634 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-93259d35-0971-4a00-b24b-0265152155fe tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:45.220887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f0511021-0aff-4d45-b86d-0c6281109e4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:45.221791 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-93259d35-0971-4a00-b24b-0265152155fe tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:45.222574 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-93259d35-0971-4a00-b24b-0265152155fe tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:45.223862 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-93259d35-0971-4a00-b24b-0265152155fe tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:45.423823 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f0511021-0aff-4d45-b86d-0c6281109e4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:45.427553 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-93259d35-0971-4a00-b24b-0265152155fe tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:45.433616 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f0511021-0aff-4d45-b86d-0c6281109e4c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.228982 Sep 01 17:40:45.434303 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 314/590] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:45 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:45.436525 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-93259d35-0971-4a00-b24b-0265152155fe tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:45.438051 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-93259d35-0971-4a00-b24b-0265152155fe tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:45.439172 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-679301625", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "networks": [{"uuid": "da5f2140-1185-44ef-89ed-d0fff147fb88"}]}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:45.439324 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-93259d35-0971-4a00-b24b-0265152155fe tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.237745 Sep 01 17:40:45.439731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 277/591] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:45 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:45.497063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.network.neutron [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] validate_networks() for [('da5f2140-1185-44ef-89ed-d0fff147fb88', None, None, None, None, None)] {{(pid=127233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:40:45.865923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Flavor limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:40:45.866548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Image limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:40:45.866809 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Flavor pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:40:45.867217 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Image pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:40:45.867623 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:40:45.876516 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:45.876999 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:45.877435 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:45.878208 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:45.878659 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:45.879472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:45.897653 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Getting quotas for project 6695ac82241740f5ac5f73b4bcdac5f5. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:40:45.902564 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Getting quotas for user 66366eb7b7044786b23d08676c14670f and project 6695ac82241740f5ac5f73b4bcdac5f5. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:40:45.905030 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:45.917430 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Going to run 1 instances... {{(pid=127233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:40:45.919730 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:40:45.972344 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f8b9cfb8-1aad-4214-8c7f-a927bd45d3a3 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.536542 Sep 01 17:40:45.979465 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 315/592] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:40:45 2022] POST /compute/v2.1/servers => generated 382 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:40:45.984786 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f13566f8-1c84-4218-9600-ce8f0f49d57d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:45.985401 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f13566f8-1c84-4218-9600-ce8f0f49d57d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:46.054372 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f13566f8-1c84-4218-9600-ce8f0f49d57d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:46.061553 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f13566f8-1c84-4218-9600-ce8f0f49d57d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1222 microversion: 2.1 time: 0.080650 Sep 01 17:40:46.062156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 278/593] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:45 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:46.194117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5e4b9663-1bc1-4969-bdcb-5b2bc86bfcfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:46.194962 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5e4b9663-1bc1-4969-bdcb-5b2bc86bfcfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:46.202238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e4b9663-1bc1-4969-bdcb-5b2bc86bfcfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:46.202850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e4b9663-1bc1-4969-bdcb-5b2bc86bfcfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:46.203333 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e4b9663-1bc1-4969-bdcb-5b2bc86bfcfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:46.204471 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e4b9663-1bc1-4969-bdcb-5b2bc86bfcfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:46.204966 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e4b9663-1bc1-4969-bdcb-5b2bc86bfcfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:46.205445 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e4b9663-1bc1-4969-bdcb-5b2bc86bfcfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:46.362222 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5e4b9663-1bc1-4969-bdcb-5b2bc86bfcfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:46.371133 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5e4b9663-1bc1-4969-bdcb-5b2bc86bfcfd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1558 microversion: 2.1 time: 0.182186 Sep 01 17:40:46.371846 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 316/594] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:46 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:46.393472 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-894e9229-6d91-4b54-b8ec-595a5639cbc6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:46.393472 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-894e9229-6d91-4b54-b8ec-595a5639cbc6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:46.403429 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-894e9229-6d91-4b54-b8ec-595a5639cbc6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:46.403973 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-894e9229-6d91-4b54-b8ec-595a5639cbc6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:46.404407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-894e9229-6d91-4b54-b8ec-595a5639cbc6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:46.405109 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-894e9229-6d91-4b54-b8ec-595a5639cbc6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:46.405562 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-894e9229-6d91-4b54-b8ec-595a5639cbc6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:46.406038 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-894e9229-6d91-4b54-b8ec-595a5639cbc6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:46.460085 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4b036cb6-f815-4dac-a82e-8a9cd4fa99da tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:46.460691 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4b036cb6-f815-4dac-a82e-8a9cd4fa99da tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:46.466832 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4b036cb6-f815-4dac-a82e-8a9cd4fa99da tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:46.467322 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4b036cb6-f815-4dac-a82e-8a9cd4fa99da tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:46.467743 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4b036cb6-f815-4dac-a82e-8a9cd4fa99da tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:46.468690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4b036cb6-f815-4dac-a82e-8a9cd4fa99da tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:46.469142 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4b036cb6-f815-4dac-a82e-8a9cd4fa99da tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:46.469563 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4b036cb6-f815-4dac-a82e-8a9cd4fa99da tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:46.507133 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-894e9229-6d91-4b54-b8ec-595a5639cbc6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119416 Sep 01 17:40:46.507797 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 279/595] 10.222.0.100 () {58 vars in 1280 bytes} [Thu Sep 1 17:40:46 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:46.513307 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-1b0ccc4c-35c9-4d04-9fa6-3d85754d16b8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:46.514046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-1b0ccc4c-35c9-4d04-9fa6-3d85754d16b8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:46.521451 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1b0ccc4c-35c9-4d04-9fa6-3d85754d16b8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:46.522460 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1b0ccc4c-35c9-4d04-9fa6-3d85754d16b8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:46.522749 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1b0ccc4c-35c9-4d04-9fa6-3d85754d16b8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:46.523582 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1b0ccc4c-35c9-4d04-9fa6-3d85754d16b8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:46.524115 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1b0ccc4c-35c9-4d04-9fa6-3d85754d16b8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:46.524617 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1b0ccc4c-35c9-4d04-9fa6-3d85754d16b8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:46.822316 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4b036cb6-f815-4dac-a82e-8a9cd4fa99da tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:46.833105 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4b036cb6-f815-4dac-a82e-8a9cd4fa99da tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.378648 Sep 01 17:40:46.834788 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 317/596] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:46 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:46.853946 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1b0ccc4c-35c9-4d04-9fa6-3d85754d16b8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:46.860128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=100 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:46.872884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1b0ccc4c-35c9-4d04-9fa6-3d85754d16b8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:46.875841 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1b0ccc4c-35c9-4d04-9fa6-3d85754d16b8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:46.878142 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-1b0ccc4c-35c9-4d04-9fa6-3d85754d16b8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.368806 Sep 01 17:40:46.879912 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 280/597] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:46 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:47.083441 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-9824d0fe-1351-4bd1-b7f8-8ece944481b0 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:47.084845 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-9824d0fe-1351-4bd1-b7f8-8ece944481b0 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:47.091898 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9824d0fe-1351-4bd1-b7f8-8ece944481b0 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:47.092485 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9824d0fe-1351-4bd1-b7f8-8ece944481b0 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:47.093314 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9824d0fe-1351-4bd1-b7f8-8ece944481b0 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:47.094084 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9824d0fe-1351-4bd1-b7f8-8ece944481b0 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:47.094722 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9824d0fe-1351-4bd1-b7f8-8ece944481b0 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:47.095360 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9824d0fe-1351-4bd1-b7f8-8ece944481b0 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:47.199004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-9824d0fe-1351-4bd1-b7f8-8ece944481b0 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:47.209701 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-9824d0fe-1351-4bd1-b7f8-8ece944481b0 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1226 microversion: 2.1 time: 0.130148 Sep 01 17:40:47.225514 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 318/598] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:47 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1226 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:47.862793 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3951d387-6f8f-4cff-8e7b-d4d2088d2a8a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:47.866614 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3951d387-6f8f-4cff-8e7b-d4d2088d2a8a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:47.878725 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3951d387-6f8f-4cff-8e7b-d4d2088d2a8a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:47.879977 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3951d387-6f8f-4cff-8e7b-d4d2088d2a8a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:47.881346 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3951d387-6f8f-4cff-8e7b-d4d2088d2a8a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:47.883067 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3951d387-6f8f-4cff-8e7b-d4d2088d2a8a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:47.883956 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3951d387-6f8f-4cff-8e7b-d4d2088d2a8a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:47.885019 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3951d387-6f8f-4cff-8e7b-d4d2088d2a8a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:47.902591 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ec038e35-627c-4f5b-805e-eaa83a224376 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:47.903205 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ec038e35-627c-4f5b-805e-eaa83a224376 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:47.911068 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec038e35-627c-4f5b-805e-eaa83a224376 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:47.911726 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec038e35-627c-4f5b-805e-eaa83a224376 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:47.912171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec038e35-627c-4f5b-805e-eaa83a224376 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:47.913557 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec038e35-627c-4f5b-805e-eaa83a224376 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:47.914103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec038e35-627c-4f5b-805e-eaa83a224376 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:47.914528 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec038e35-627c-4f5b-805e-eaa83a224376 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:48.300579 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ec038e35-627c-4f5b-805e-eaa83a224376 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:48.307242 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3951d387-6f8f-4cff-8e7b-d4d2088d2a8a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:48.316286 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ec038e35-627c-4f5b-805e-eaa83a224376 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:48.318404 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ec038e35-627c-4f5b-805e-eaa83a224376 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:48.319702 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ec038e35-627c-4f5b-805e-eaa83a224376 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1813 microversion: 2.20 time: 0.420958 Sep 01 17:40:48.323047 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-3951d387-6f8f-4cff-8e7b-d4d2088d2a8a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.467777 Sep 01 17:40:48.330033 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 319/599] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:47 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1813 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:48.338679 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 281/600] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:47 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:48.340937 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4f4b3735-7e9a-41eb-9c43-420bdd298df5 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:48.342241 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4f4b3735-7e9a-41eb-9c43-420bdd298df5 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:48.350415 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4f4b3735-7e9a-41eb-9c43-420bdd298df5 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:48.351182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4f4b3735-7e9a-41eb-9c43-420bdd298df5 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:48.351789 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4f4b3735-7e9a-41eb-9c43-420bdd298df5 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:48.352666 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4f4b3735-7e9a-41eb-9c43-420bdd298df5 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:48.353284 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4f4b3735-7e9a-41eb-9c43-420bdd298df5 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:48.354047 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4f4b3735-7e9a-41eb-9c43-420bdd298df5 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:48.359893 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-bd9a3c82-9c43-4f60-ae01-0d6c9d44d1c1 req-d426f3cc-09c7-45a6-86b4-22aefad559c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e176cb-aabb-40b5-a79d-acf5d061b2da", "tag": "5be3ac5e-b565-42ad-abf6-c17408c0347c"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:48.378503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-bd9a3c82-9c43-4f60-ae01-0d6c9d44d1c1 req-d426f3cc-09c7-45a6-86b4-22aefad559c0 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:48.380383 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-bd9a3c82-9c43-4f60-ae01-0d6c9d44d1c1 req-d426f3cc-09c7-45a6-86b4-22aefad559c0 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:48.382155 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-bd9a3c82-9c43-4f60-ae01-0d6c9d44d1c1 req-d426f3cc-09c7-45a6-86b4-22aefad559c0 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:48.413071 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-bd9a3c82-9c43-4f60-ae01-0d6c9d44d1c1 req-d426f3cc-09c7-45a6-86b4-22aefad559c0 service nova] Creating event network-changed:5be3ac5e-b565-42ad-abf6-c17408c0347c for instance 92e176cb-aabb-40b5-a79d-acf5d061b2da on hv-cinder-83976 Sep 01 17:40:48.424426 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-bd9a3c82-9c43-4f60-ae01-0d6c9d44d1c1 req-d426f3cc-09c7-45a6-86b4-22aefad559c0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084121 Sep 01 17:40:48.425338 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 282/601] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:48.578461 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4f4b3735-7e9a-41eb-9c43-420bdd298df5 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:48.596914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4f4b3735-7e9a-41eb-9c43-420bdd298df5 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1274 microversion: 2.1 time: 0.256898 Sep 01 17:40:48.599962 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 320/602] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:48 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1274 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:49.348652 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c4d0c906-878b-4ca0-b75d-92916d82d3c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:49.349456 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c4d0c906-878b-4ca0-b75d-92916d82d3c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:49.355941 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ddfa172e-0d4c-4dad-9ccf-5441f8a815f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:49.356648 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ddfa172e-0d4c-4dad-9ccf-5441f8a815f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:49.359922 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c4d0c906-878b-4ca0-b75d-92916d82d3c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:49.360678 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c4d0c906-878b-4ca0-b75d-92916d82d3c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:49.362726 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c4d0c906-878b-4ca0-b75d-92916d82d3c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:49.364210 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c4d0c906-878b-4ca0-b75d-92916d82d3c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:49.365334 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ddfa172e-0d4c-4dad-9ccf-5441f8a815f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:49.365848 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c4d0c906-878b-4ca0-b75d-92916d82d3c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:49.366002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ddfa172e-0d4c-4dad-9ccf-5441f8a815f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:49.366307 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ddfa172e-0d4c-4dad-9ccf-5441f8a815f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:49.366746 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c4d0c906-878b-4ca0-b75d-92916d82d3c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:49.367029 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ddfa172e-0d4c-4dad-9ccf-5441f8a815f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:49.367487 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ddfa172e-0d4c-4dad-9ccf-5441f8a815f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:49.367913 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ddfa172e-0d4c-4dad-9ccf-5441f8a815f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:49.391399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=100 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:49.793474 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ddfa172e-0d4c-4dad-9ccf-5441f8a815f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:49.797637 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c4d0c906-878b-4ca0-b75d-92916d82d3c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:49.802580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ddfa172e-0d4c-4dad-9ccf-5441f8a815f0 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.450423 Sep 01 17:40:49.803146 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 321/603] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:49 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:49.808882 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-372a0283-7742-41e0-b918-2b9d8fe44b77 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:49.809480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-372a0283-7742-41e0-b918-2b9d8fe44b77 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:49.813683 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c4d0c906-878b-4ca0-b75d-92916d82d3c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:49.815850 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-372a0283-7742-41e0-b918-2b9d8fe44b77 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:49.816343 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-372a0283-7742-41e0-b918-2b9d8fe44b77 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:49.816977 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c4d0c906-878b-4ca0-b75d-92916d82d3c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:49.817125 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-372a0283-7742-41e0-b918-2b9d8fe44b77 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:49.817873 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-372a0283-7742-41e0-b918-2b9d8fe44b77 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:49.818336 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-372a0283-7742-41e0-b918-2b9d8fe44b77 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:49.818767 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-372a0283-7742-41e0-b918-2b9d8fe44b77 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:49.819279 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c4d0c906-878b-4ca0-b75d-92916d82d3c9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1800 microversion: 2.20 time: 0.475327 Sep 01 17:40:49.820309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 283/604] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:49 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1800 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:49.884914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-372a0283-7742-41e0-b918-2b9d8fe44b77 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:49.893024 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-372a0283-7742-41e0-b918-2b9d8fe44b77 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1292 microversion: 2.1 time: 0.088912 Sep 01 17:40:49.893628 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 322/605] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:49 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:50.824933 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-febfc70a-59db-4436-849b-d1bc580aa5f9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:50.825551 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-febfc70a-59db-4436-849b-d1bc580aa5f9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:50.832510 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-febfc70a-59db-4436-849b-d1bc580aa5f9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:50.833131 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-febfc70a-59db-4436-849b-d1bc580aa5f9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:50.833804 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-febfc70a-59db-4436-849b-d1bc580aa5f9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:50.834583 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-febfc70a-59db-4436-849b-d1bc580aa5f9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:50.835116 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-febfc70a-59db-4436-849b-d1bc580aa5f9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:50.835616 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-febfc70a-59db-4436-849b-d1bc580aa5f9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:50.916408 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a8d1ed65-c569-4259-9c29-912b72fa5b78 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:50.917382 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a8d1ed65-c569-4259-9c29-912b72fa5b78 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:50.924336 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a8d1ed65-c569-4259-9c29-912b72fa5b78 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:50.924933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a8d1ed65-c569-4259-9c29-912b72fa5b78 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:50.925448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a8d1ed65-c569-4259-9c29-912b72fa5b78 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:50.927071 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a8d1ed65-c569-4259-9c29-912b72fa5b78 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:50.927613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a8d1ed65-c569-4259-9c29-912b72fa5b78 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:50.928135 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a8d1ed65-c569-4259-9c29-912b72fa5b78 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:51.024345 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a8d1ed65-c569-4259-9c29-912b72fa5b78 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:51.032283 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a8d1ed65-c569-4259-9c29-912b72fa5b78 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1280 microversion: 2.1 time: 0.120095 Sep 01 17:40:51.032868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 323/606] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:50 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1280 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:51.109292 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-febfc70a-59db-4436-849b-d1bc580aa5f9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:51.119615 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-febfc70a-59db-4436-849b-d1bc580aa5f9 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.298537 Sep 01 17:40:51.120341 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 284/607] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:50 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:52.057732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7d5f13d0-f441-40f0-8768-80f7e1ec6621 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:52.058901 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7d5f13d0-f441-40f0-8768-80f7e1ec6621 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:52.065469 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d5f13d0-f441-40f0-8768-80f7e1ec6621 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:52.066068 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d5f13d0-f441-40f0-8768-80f7e1ec6621 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:52.066597 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d5f13d0-f441-40f0-8768-80f7e1ec6621 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:52.067786 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d5f13d0-f441-40f0-8768-80f7e1ec6621 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:52.068272 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d5f13d0-f441-40f0-8768-80f7e1ec6621 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:52.068821 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7d5f13d0-f441-40f0-8768-80f7e1ec6621 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:52.141940 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-848e87c1-d56b-4d31-a442-1440309370cb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:52.142571 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-848e87c1-d56b-4d31-a442-1440309370cb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:52.149527 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-848e87c1-d56b-4d31-a442-1440309370cb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:52.150098 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-848e87c1-d56b-4d31-a442-1440309370cb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:52.150531 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-848e87c1-d56b-4d31-a442-1440309370cb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:52.151438 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-848e87c1-d56b-4d31-a442-1440309370cb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:52.151609 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-848e87c1-d56b-4d31-a442-1440309370cb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:52.152033 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-848e87c1-d56b-4d31-a442-1440309370cb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:52.346176 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7d5f13d0-f441-40f0-8768-80f7e1ec6621 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:52.356063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7d5f13d0-f441-40f0-8768-80f7e1ec6621 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1322 microversion: 2.1 time: 0.304974 Sep 01 17:40:52.356668 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 324/608] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:52 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:52.375011 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-ac064e3a-136c-4f43-99ab-f4ac7246ed7e req-b702c4ad-e279-494b-978b-65e17319c629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f90fd38-f49d-4675-9502-0d9a988ae971", "tag": "421d832d-5d75-423b-bf4b-221cde95e2e3"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:52.384987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-ac064e3a-136c-4f43-99ab-f4ac7246ed7e req-b702c4ad-e279-494b-978b-65e17319c629 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:52.385484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-ac064e3a-136c-4f43-99ab-f4ac7246ed7e req-b702c4ad-e279-494b-978b-65e17319c629 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:52.385929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-ac064e3a-136c-4f43-99ab-f4ac7246ed7e req-b702c4ad-e279-494b-978b-65e17319c629 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:52.397448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-ac064e3a-136c-4f43-99ab-f4ac7246ed7e req-b702c4ad-e279-494b-978b-65e17319c629 service nova] Creating event network-changed:421d832d-5d75-423b-bf4b-221cde95e2e3 for instance 7f90fd38-f49d-4675-9502-0d9a988ae971 on hv-cinder-83976 Sep 01 17:40:52.402526 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-ac064e3a-136c-4f43-99ab-f4ac7246ed7e req-b702c4ad-e279-494b-978b-65e17319c629 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031116 Sep 01 17:40:52.403129 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 325/609] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:40:52.430172 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-848e87c1-d56b-4d31-a442-1440309370cb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:52.438727 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-848e87c1-d56b-4d31-a442-1440309370cb tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1742 microversion: 2.1 time: 0.300797 Sep 01 17:40:52.439304 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 285/610] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:52 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1742 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:53.378534 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ad3d85ed-1c87-4d23-9f01-ebcc8f081ffd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:53.379416 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ad3d85ed-1c87-4d23-9f01-ebcc8f081ffd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:53.386136 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3d85ed-1c87-4d23-9f01-ebcc8f081ffd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:53.386739 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3d85ed-1c87-4d23-9f01-ebcc8f081ffd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:53.387225 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3d85ed-1c87-4d23-9f01-ebcc8f081ffd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:53.387996 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3d85ed-1c87-4d23-9f01-ebcc8f081ffd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:53.388543 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3d85ed-1c87-4d23-9f01-ebcc8f081ffd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:53.389006 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3d85ed-1c87-4d23-9f01-ebcc8f081ffd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:53.463506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2a58899a-4efb-4734-b9c9-5eabaefbaf91 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:53.464268 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2a58899a-4efb-4734-b9c9-5eabaefbaf91 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:53.472046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a58899a-4efb-4734-b9c9-5eabaefbaf91 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:53.472367 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a58899a-4efb-4734-b9c9-5eabaefbaf91 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:53.472744 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a58899a-4efb-4734-b9c9-5eabaefbaf91 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:53.474733 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a58899a-4efb-4734-b9c9-5eabaefbaf91 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:53.475138 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a58899a-4efb-4734-b9c9-5eabaefbaf91 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:53.475614 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2a58899a-4efb-4734-b9c9-5eabaefbaf91 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:53.576683 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ad3d85ed-1c87-4d23-9f01-ebcc8f081ffd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:53.586232 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ad3d85ed-1c87-4d23-9f01-ebcc8f081ffd tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1322 microversion: 2.1 time: 0.212527 Sep 01 17:40:53.586956 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 326/611] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:53 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:53.664047 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2a58899a-4efb-4734-b9c9-5eabaefbaf91 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:53.675832 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2a58899a-4efb-4734-b9c9-5eabaefbaf91 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1722 microversion: 2.1 time: 0.218246 Sep 01 17:40:53.677399 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 286/612] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:53 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:53.824274 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6d18cd64-71a3-4219-ad2d-d9910681f309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:53.824776 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6d18cd64-71a3-4219-ad2d-d9910681f309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:53.831293 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6d18cd64-71a3-4219-ad2d-d9910681f309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:53.831774 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6d18cd64-71a3-4219-ad2d-d9910681f309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:53.832326 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6d18cd64-71a3-4219-ad2d-d9910681f309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:53.833062 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6d18cd64-71a3-4219-ad2d-d9910681f309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:53.833518 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6d18cd64-71a3-4219-ad2d-d9910681f309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:53.833984 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6d18cd64-71a3-4219-ad2d-d9910681f309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:53.974660 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-6d18cd64-71a3-4219-ad2d-d9910681f309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] HTTP exception thrown: Cannot 'detach_volume' instance fd635ada-9195-43da-a0a3-b131c9132dd6 while it is in vm_state rescued Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6d18cd64-71a3-4219-ad2d-d9910681f309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Request method failure captured: Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: DELETE /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-volume_attachments/044dacc7-9c15-4894-9825-15127b94aa9f HTTP/1.1 Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2m8zyf1MdfI9Plug8mrFjRApjQ5c-8jQisg1PVk0tj5vFsUELO_1M1udUcyP_UxAfWvOWoJ8fDtqa8LTzrnjXG6uPV0irrnSvS-1H3XCvA0zw3nvSo7ARUEiib2-x1XXV_v7wdYFSh1m3JfZWwThjo3uq-lxNxGev-IFpfAVdzDqI Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: b01df46ff9744c2f830459547d7e4dd6 Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:40:53.976311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:40:53.977985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:40:53.977985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:40:53.977985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: b01df46ff9744c2f830459547d7e4dd6 Sep 01 17:40:53.977985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:40:53.977985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-ServerRescueNegativeTestJSON-1908064911-project Sep 01 17:40:53.977985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:40:53.977985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:40:53.977985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: 5647214c5b3f438eb3ef1ddc14153d9e Sep 01 17:40:53.977985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1908064911-project Sep 01 17:40:53.977985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:40:53.977985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Cannot 'detach_volume' instance fd635ada-9195-43da-a0a3-b131c9132dd6 while it is in vm_state rescued Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'server_id': 'fd635ada-9195-43da-a0a3-b131c9132dd6', 'id': '044dacc7-9c15-4894-9825-15127b94aa9f'} Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fd635ada-9195-43da-a0a3-b131c9132dd6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:40:53.982063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fd635ada-9195-43da-a0a3-b131c9132dd6 while it is in vm_state rescued Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fd635ada-9195-43da-a0a3-b131c9132dd6 while it is in vm_state rescued Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:40:53.983561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6d18cd64-71a3-4219-ad2d-d9910681f309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Returning 409 to user: Cannot 'detach_volume' instance fd635ada-9195-43da-a0a3-b131c9132dd6 while it is in vm_state rescued {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:40:53.984741 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-6d18cd64-71a3-4219-ad2d-d9910681f309 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "DELETE /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-volume_attachments/044dacc7-9c15-4894-9825-15127b94aa9f" status: 409 len: 152 microversion: 2.1 time: 0.157692 Sep 01 17:40:53.984741 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 327/613] 10.222.0.100 () {58 vars in 1421 bytes} [Thu Sep 1 17:40:53 2022] DELETE /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-volume_attachments/044dacc7-9c15-4894-9825-15127b94aa9f => generated 152 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 01 17:40:53.987809 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e56d52ac-5f1e-4847-841f-db73f237a746 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:53.989226 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e56d52ac-5f1e-4847-841f-db73f237a746 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:53.996114 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e56d52ac-5f1e-4847-841f-db73f237a746 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:53.996615 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e56d52ac-5f1e-4847-841f-db73f237a746 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:53.997063 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e56d52ac-5f1e-4847-841f-db73f237a746 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:53.997843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e56d52ac-5f1e-4847-841f-db73f237a746 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:53.998311 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e56d52ac-5f1e-4847-841f-db73f237a746 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:53.998744 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e56d52ac-5f1e-4847-841f-db73f237a746 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:54.074533 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e56d52ac-5f1e-4847-841f-db73f237a746 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "POST /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/action" status: 202 len: 0 microversion: 2.1 time: 0.091066 Sep 01 17:40:54.075125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 287/614] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:40:53 2022] POST /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:40:54.085420 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ff252c10-0ed1-4acd-927c-b558d8f4a58c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:54.086123 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ff252c10-0ed1-4acd-927c-b558d8f4a58c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:54.093719 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ff252c10-0ed1-4acd-927c-b558d8f4a58c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:54.094254 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ff252c10-0ed1-4acd-927c-b558d8f4a58c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:54.094686 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ff252c10-0ed1-4acd-927c-b558d8f4a58c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:54.095416 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ff252c10-0ed1-4acd-927c-b558d8f4a58c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:54.095869 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ff252c10-0ed1-4acd-927c-b558d8f4a58c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:54.096387 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ff252c10-0ed1-4acd-927c-b558d8f4a58c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:54.242243 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ff252c10-0ed1-4acd-927c-b558d8f4a58c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:54.250807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ff252c10-0ed1-4acd-927c-b558d8f4a58c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1730 microversion: 2.1 time: 0.169888 Sep 01 17:40:54.251385 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 328/615] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:54 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:54.612503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5b14f5e1-87fe-4a56-80fd-b95a114d71f8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:54.613398 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5b14f5e1-87fe-4a56-80fd-b95a114d71f8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:54.620270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5b14f5e1-87fe-4a56-80fd-b95a114d71f8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:54.620943 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5b14f5e1-87fe-4a56-80fd-b95a114d71f8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:54.621407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5b14f5e1-87fe-4a56-80fd-b95a114d71f8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:54.622149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5b14f5e1-87fe-4a56-80fd-b95a114d71f8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:54.622605 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5b14f5e1-87fe-4a56-80fd-b95a114d71f8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:54.623023 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5b14f5e1-87fe-4a56-80fd-b95a114d71f8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:54.866715 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5b14f5e1-87fe-4a56-80fd-b95a114d71f8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:54.875106 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5b14f5e1-87fe-4a56-80fd-b95a114d71f8 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1322 microversion: 2.1 time: 0.267538 Sep 01 17:40:54.875727 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 288/616] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:54 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:55.273356 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-813c1b54-d96d-4167-ad16-acb22a898c6b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:55.274028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-813c1b54-d96d-4167-ad16-acb22a898c6b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:55.284386 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-813c1b54-d96d-4167-ad16-acb22a898c6b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:55.284386 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-813c1b54-d96d-4167-ad16-acb22a898c6b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:55.284386 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-813c1b54-d96d-4167-ad16-acb22a898c6b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:55.284386 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-813c1b54-d96d-4167-ad16-acb22a898c6b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:55.284869 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-813c1b54-d96d-4167-ad16-acb22a898c6b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:55.284869 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-813c1b54-d96d-4167-ad16-acb22a898c6b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:55.431484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-813c1b54-d96d-4167-ad16-acb22a898c6b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:55.441065 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-813c1b54-d96d-4167-ad16-acb22a898c6b tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1730 microversion: 2.1 time: 0.172273 Sep 01 17:40:55.442234 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 329/617] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:55 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:55.898860 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b9847f87-dadf-4db7-a536-7f75f8f41335 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:55.899439 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b9847f87-dadf-4db7-a536-7f75f8f41335 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:55.906078 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b9847f87-dadf-4db7-a536-7f75f8f41335 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:55.906608 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b9847f87-dadf-4db7-a536-7f75f8f41335 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:55.906990 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b9847f87-dadf-4db7-a536-7f75f8f41335 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:55.907672 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b9847f87-dadf-4db7-a536-7f75f8f41335 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:55.908116 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b9847f87-dadf-4db7-a536-7f75f8f41335 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:55.908534 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b9847f87-dadf-4db7-a536-7f75f8f41335 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:56.047338 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b9847f87-dadf-4db7-a536-7f75f8f41335 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:56.055668 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b9847f87-dadf-4db7-a536-7f75f8f41335 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1322 microversion: 2.1 time: 0.160868 Sep 01 17:40:56.056261 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 289/618] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:55 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:56.463990 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0a733df7-2892-4ca7-aa18-91184800fd41 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:56.464655 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0a733df7-2892-4ca7-aa18-91184800fd41 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:56.466839 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:56.467500 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=6 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:56.477611 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0a733df7-2892-4ca7-aa18-91184800fd41 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:56.478410 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0a733df7-2892-4ca7-aa18-91184800fd41 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:56.479171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0a733df7-2892-4ca7-aa18-91184800fd41 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:56.479912 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0a733df7-2892-4ca7-aa18-91184800fd41 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:56.480380 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0a733df7-2892-4ca7-aa18-91184800fd41 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:56.480810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0a733df7-2892-4ca7-aa18-91184800fd41 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:56.636570 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0a733df7-2892-4ca7-aa18-91184800fd41 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:56.645552 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0a733df7-2892-4ca7-aa18-91184800fd41 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1730 microversion: 2.1 time: 0.185678 Sep 01 17:40:56.646339 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 330/619] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:56 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:57.077288 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-da232d17-7eb7-484d-be6d-801f72eabe87 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:57.077929 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-da232d17-7eb7-484d-be6d-801f72eabe87 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:57.079924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:57.085780 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da232d17-7eb7-484d-be6d-801f72eabe87 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:57.086270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da232d17-7eb7-484d-be6d-801f72eabe87 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:57.086714 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da232d17-7eb7-484d-be6d-801f72eabe87 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:57.087417 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da232d17-7eb7-484d-be6d-801f72eabe87 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:57.087875 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da232d17-7eb7-484d-be6d-801f72eabe87 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:57.088304 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da232d17-7eb7-484d-be6d-801f72eabe87 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:57.226307 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-da232d17-7eb7-484d-be6d-801f72eabe87 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:57.234863 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-da232d17-7eb7-484d-be6d-801f72eabe87 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1322 microversion: 2.1 time: 0.161611 Sep 01 17:40:57.235452 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 290/620] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:57 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:57.670836 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d4bc1224-35e6-4d8e-893e-ec26f66e5dc5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:57.673133 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d4bc1224-35e6-4d8e-893e-ec26f66e5dc5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:57.685254 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d4bc1224-35e6-4d8e-893e-ec26f66e5dc5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:57.685825 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d4bc1224-35e6-4d8e-893e-ec26f66e5dc5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:57.686355 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d4bc1224-35e6-4d8e-893e-ec26f66e5dc5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:57.687102 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d4bc1224-35e6-4d8e-893e-ec26f66e5dc5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:57.687559 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d4bc1224-35e6-4d8e-893e-ec26f66e5dc5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:57.688058 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d4bc1224-35e6-4d8e-893e-ec26f66e5dc5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:57.839980 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d4bc1224-35e6-4d8e-893e-ec26f66e5dc5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:57.848589 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d4bc1224-35e6-4d8e-893e-ec26f66e5dc5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1736 microversion: 2.1 time: 0.183245 Sep 01 17:40:57.849182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 331/621] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:57 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:57.869793 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2af3752e-cbb8-47f6-ad12-5dcbdca5d4ee tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:57.870359 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2af3752e-cbb8-47f6-ad12-5dcbdca5d4ee tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:57.876666 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2af3752e-cbb8-47f6-ad12-5dcbdca5d4ee tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:57.877162 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2af3752e-cbb8-47f6-ad12-5dcbdca5d4ee tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:57.877630 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2af3752e-cbb8-47f6-ad12-5dcbdca5d4ee tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:57.878342 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2af3752e-cbb8-47f6-ad12-5dcbdca5d4ee tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:57.878800 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2af3752e-cbb8-47f6-ad12-5dcbdca5d4ee tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:57.879236 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2af3752e-cbb8-47f6-ad12-5dcbdca5d4ee tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:57.960474 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2af3752e-cbb8-47f6-ad12-5dcbdca5d4ee tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094617 Sep 01 17:40:57.961078 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 291/622] 10.222.0.100 () {58 vars in 1280 bytes} [Thu Sep 1 17:40:57 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:58.169111 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-59314822-2132-4205-9323-ce5089c5ce1b req-92ce1b21-446f-4fd6-b9b8-c656c118b63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f90fd38-f49d-4675-9502-0d9a988ae971", "name": "network-vif-plugged", "status": "completed", "tag": "421d832d-5d75-423b-bf4b-221cde95e2e3"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:58.187326 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-59314822-2132-4205-9323-ce5089c5ce1b req-92ce1b21-446f-4fd6-b9b8-c656c118b63e service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:58.188678 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-59314822-2132-4205-9323-ce5089c5ce1b req-92ce1b21-446f-4fd6-b9b8-c656c118b63e service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:58.189490 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-59314822-2132-4205-9323-ce5089c5ce1b req-92ce1b21-446f-4fd6-b9b8-c656c118b63e service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:58.207093 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-59314822-2132-4205-9323-ce5089c5ce1b req-92ce1b21-446f-4fd6-b9b8-c656c118b63e service nova] Creating event network-vif-plugged:421d832d-5d75-423b-bf4b-221cde95e2e3 for instance 7f90fd38-f49d-4675-9502-0d9a988ae971 on hv-cinder-83976 Sep 01 17:40:58.215487 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-59314822-2132-4205-9323-ce5089c5ce1b req-92ce1b21-446f-4fd6-b9b8-c656c118b63e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050407 Sep 01 17:40:58.216321 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 332/623] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:58.260061 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f421377a-7cd2-4b92-823f-dc7949f6a72b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:58.260802 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f421377a-7cd2-4b92-823f-dc7949f6a72b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:58.264617 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=88 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:58.270702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f421377a-7cd2-4b92-823f-dc7949f6a72b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:58.272141 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f421377a-7cd2-4b92-823f-dc7949f6a72b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:58.272947 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f421377a-7cd2-4b92-823f-dc7949f6a72b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:58.274641 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f421377a-7cd2-4b92-823f-dc7949f6a72b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:58.275715 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f421377a-7cd2-4b92-823f-dc7949f6a72b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:58.276508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f421377a-7cd2-4b92-823f-dc7949f6a72b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:58.691811 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f421377a-7cd2-4b92-823f-dc7949f6a72b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:58.702098 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f421377a-7cd2-4b92-823f-dc7949f6a72b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1322 microversion: 2.1 time: 0.447298 Sep 01 17:40:58.710902 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 292/624] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:58 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:59.497104 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-d6044302-7d4a-4b71-9e15-0a7fe2214dff req-ad1a9242-7a15-41b0-9516-024dc4cc4f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd635ada-9195-43da-a0a3-b131c9132dd6", "tag": "9345839b-552d-4f2c-8201-39a0d79147af"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:59.508667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-d6044302-7d4a-4b71-9e15-0a7fe2214dff req-ad1a9242-7a15-41b0-9516-024dc4cc4f17 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:59.509121 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-d6044302-7d4a-4b71-9e15-0a7fe2214dff req-ad1a9242-7a15-41b0-9516-024dc4cc4f17 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:59.509815 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-d6044302-7d4a-4b71-9e15-0a7fe2214dff req-ad1a9242-7a15-41b0-9516-024dc4cc4f17 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:59.523975 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-d6044302-7d4a-4b71-9e15-0a7fe2214dff req-ad1a9242-7a15-41b0-9516-024dc4cc4f17 service nova] Creating event network-changed:9345839b-552d-4f2c-8201-39a0d79147af for instance fd635ada-9195-43da-a0a3-b131c9132dd6 on hv-cinder-83976 Sep 01 17:40:59.529214 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-d6044302-7d4a-4b71-9e15-0a7fe2214dff req-ad1a9242-7a15-41b0-9516-024dc4cc4f17 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036688 Sep 01 17:40:59.530142 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 333/625] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:59.723146 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6ba369e2-e7cb-46a8-bf55-5c84109bc277 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:59.725287 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6ba369e2-e7cb-46a8-bf55-5c84109bc277 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:59.737903 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ba369e2-e7cb-46a8-bf55-5c84109bc277 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:59.738686 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ba369e2-e7cb-46a8-bf55-5c84109bc277 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:59.739733 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ba369e2-e7cb-46a8-bf55-5c84109bc277 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:59.741703 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ba369e2-e7cb-46a8-bf55-5c84109bc277 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:59.742558 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ba369e2-e7cb-46a8-bf55-5c84109bc277 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:59.743343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ba369e2-e7cb-46a8-bf55-5c84109bc277 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:59.984056 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6ba369e2-e7cb-46a8-bf55-5c84109bc277 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:59.994079 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6ba369e2-e7cb-46a8-bf55-5c84109bc277 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1322 microversion: 2.1 time: 0.274802 Sep 01 17:40:59.994762 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 293/626] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:59 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:41:01.015779 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f36cc385-50d2-414f-b7e7-49cd949a6748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:01.016372 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f36cc385-50d2-414f-b7e7-49cd949a6748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:01.023978 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f36cc385-50d2-414f-b7e7-49cd949a6748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:01.024563 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f36cc385-50d2-414f-b7e7-49cd949a6748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:01.024997 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f36cc385-50d2-414f-b7e7-49cd949a6748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:01.025761 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f36cc385-50d2-414f-b7e7-49cd949a6748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:01.026213 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f36cc385-50d2-414f-b7e7-49cd949a6748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:01.026628 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f36cc385-50d2-414f-b7e7-49cd949a6748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:01.178202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f36cc385-50d2-414f-b7e7-49cd949a6748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:01.186188 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f36cc385-50d2-414f-b7e7-49cd949a6748 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1322 microversion: 2.1 time: 0.175115 Sep 01 17:41:01.186789 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 334/627] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:01 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:01.546667 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-36c756ad-168b-410c-a389-2033d459970c req-e7ce756d-d4a1-4353-99ed-d6ef32433797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd635ada-9195-43da-a0a3-b131c9132dd6", "tag": "9345839b-552d-4f2c-8201-39a0d79147af"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:01.557874 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-36c756ad-168b-410c-a389-2033d459970c req-e7ce756d-d4a1-4353-99ed-d6ef32433797 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:01.558367 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-36c756ad-168b-410c-a389-2033d459970c req-e7ce756d-d4a1-4353-99ed-d6ef32433797 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:01.558800 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-36c756ad-168b-410c-a389-2033d459970c req-e7ce756d-d4a1-4353-99ed-d6ef32433797 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:01.571278 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-36c756ad-168b-410c-a389-2033d459970c req-e7ce756d-d4a1-4353-99ed-d6ef32433797 service nova] Creating event network-changed:9345839b-552d-4f2c-8201-39a0d79147af for instance fd635ada-9195-43da-a0a3-b131c9132dd6 on hv-cinder-83976 Sep 01 17:41:01.577139 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-36c756ad-168b-410c-a389-2033d459970c req-e7ce756d-d4a1-4353-99ed-d6ef32433797 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034492 Sep 01 17:41:01.577814 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 294/628] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:41:02.207890 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-9dbcf43f-8d34-49a7-a45a-974ca035025d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:02.208507 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-9dbcf43f-8d34-49a7-a45a-974ca035025d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:02.215204 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9dbcf43f-8d34-49a7-a45a-974ca035025d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:02.215610 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9dbcf43f-8d34-49a7-a45a-974ca035025d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:02.216038 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9dbcf43f-8d34-49a7-a45a-974ca035025d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:02.216726 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9dbcf43f-8d34-49a7-a45a-974ca035025d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:02.217170 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9dbcf43f-8d34-49a7-a45a-974ca035025d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:02.217598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9dbcf43f-8d34-49a7-a45a-974ca035025d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:02.366558 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-9dbcf43f-8d34-49a7-a45a-974ca035025d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:02.374182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-9dbcf43f-8d34-49a7-a45a-974ca035025d tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1511 microversion: 2.1 time: 0.170270 Sep 01 17:41:02.374762 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 335/629] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:02 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:02.395664 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c298e7da-6c38-4649-a4aa-ca12d163ce1e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1694b0e1-2718-4d87-8768-3291384efdea", "device": "/dev/sdb"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:02.398839 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c298e7da-6c38-4649-a4aa-ca12d163ce1e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:02.405061 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c298e7da-6c38-4649-a4aa-ca12d163ce1e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:02.405540 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c298e7da-6c38-4649-a4aa-ca12d163ce1e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:02.406028 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c298e7da-6c38-4649-a4aa-ca12d163ce1e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:02.406732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c298e7da-6c38-4649-a4aa-ca12d163ce1e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:02.407186 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c298e7da-6c38-4649-a4aa-ca12d163ce1e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:02.407608 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c298e7da-6c38-4649-a4aa-ca12d163ce1e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:02.674509 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c298e7da-6c38-4649-a4aa-ca12d163ce1e tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "POST /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283062 Sep 01 17:41:02.675308 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 295/630] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:41:02 2022] POST /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:41:05.056553 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cf91ea03-c159-47be-bde6-15996de8fd61 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:05.058740 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cf91ea03-c159-47be-bde6-15996de8fd61 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:05.065703 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cf91ea03-c159-47be-bde6-15996de8fd61 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:05.066222 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cf91ea03-c159-47be-bde6-15996de8fd61 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:05.066654 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cf91ea03-c159-47be-bde6-15996de8fd61 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:05.067367 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cf91ea03-c159-47be-bde6-15996de8fd61 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:05.067825 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cf91ea03-c159-47be-bde6-15996de8fd61 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:05.068393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cf91ea03-c159-47be-bde6-15996de8fd61 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:05.155480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cf91ea03-c159-47be-bde6-15996de8fd61 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "POST /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/action" status: 202 len: 0 microversion: 2.1 time: 0.103376 Sep 01 17:41:05.159630 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 336/631] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:41:05 2022] POST /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:41:05.168031 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c6e64977-bd8b-488f-97ab-a76f650fb7ea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:05.168735 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c6e64977-bd8b-488f-97ab-a76f650fb7ea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:05.176143 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c6e64977-bd8b-488f-97ab-a76f650fb7ea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:05.176661 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c6e64977-bd8b-488f-97ab-a76f650fb7ea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:05.177120 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c6e64977-bd8b-488f-97ab-a76f650fb7ea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:05.178507 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c6e64977-bd8b-488f-97ab-a76f650fb7ea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:05.179308 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c6e64977-bd8b-488f-97ab-a76f650fb7ea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:05.180089 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c6e64977-bd8b-488f-97ab-a76f650fb7ea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:05.433200 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c6e64977-bd8b-488f-97ab-a76f650fb7ea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:05.436789 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:05.442498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c6e64977-bd8b-488f-97ab-a76f650fb7ea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1756 microversion: 2.1 time: 0.281001 Sep 01 17:41:05.443079 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 296/632] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:05 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1756 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:41:06.466241 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-61f2cded-55ac-4e79-8fdb-dbdbeb9e8366 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:06.466947 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-61f2cded-55ac-4e79-8fdb-dbdbeb9e8366 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:06.473610 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-61f2cded-55ac-4e79-8fdb-dbdbeb9e8366 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:06.474111 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-61f2cded-55ac-4e79-8fdb-dbdbeb9e8366 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:06.475434 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-61f2cded-55ac-4e79-8fdb-dbdbeb9e8366 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:06.476189 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-61f2cded-55ac-4e79-8fdb-dbdbeb9e8366 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:06.476651 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-61f2cded-55ac-4e79-8fdb-dbdbeb9e8366 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:06.477082 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-61f2cded-55ac-4e79-8fdb-dbdbeb9e8366 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:06.643816 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-61f2cded-55ac-4e79-8fdb-dbdbeb9e8366 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:06.652478 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-61f2cded-55ac-4e79-8fdb-dbdbeb9e8366 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.191029 Sep 01 17:41:06.653077 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 337/633] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:06 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:07.676326 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-726a914c-800d-45bb-bf5c-477f25ed3852 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:07.677012 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-726a914c-800d-45bb-bf5c-477f25ed3852 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:07.685746 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-726a914c-800d-45bb-bf5c-477f25ed3852 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:07.686243 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-726a914c-800d-45bb-bf5c-477f25ed3852 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:07.686690 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-726a914c-800d-45bb-bf5c-477f25ed3852 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:07.687418 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-726a914c-800d-45bb-bf5c-477f25ed3852 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:07.687878 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-726a914c-800d-45bb-bf5c-477f25ed3852 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:07.688340 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-726a914c-800d-45bb-bf5c-477f25ed3852 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:07.848861 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-726a914c-800d-45bb-bf5c-477f25ed3852 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:07.858250 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-726a914c-800d-45bb-bf5c-477f25ed3852 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.186595 Sep 01 17:41:07.858829 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 297/634] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:07 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:41:08.879425 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-836402eb-2aea-48aa-94c3-ccecd3270a8a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:08.880034 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-836402eb-2aea-48aa-94c3-ccecd3270a8a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:08.887383 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-836402eb-2aea-48aa-94c3-ccecd3270a8a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:08.887861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-836402eb-2aea-48aa-94c3-ccecd3270a8a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:08.888327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-836402eb-2aea-48aa-94c3-ccecd3270a8a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:08.889029 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-836402eb-2aea-48aa-94c3-ccecd3270a8a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:08.889479 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-836402eb-2aea-48aa-94c3-ccecd3270a8a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:08.889930 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-836402eb-2aea-48aa-94c3-ccecd3270a8a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:09.060172 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-836402eb-2aea-48aa-94c3-ccecd3270a8a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:09.064237 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:09.077369 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-836402eb-2aea-48aa-94c3-ccecd3270a8a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.201708 Sep 01 17:41:09.078195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 338/635] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:08 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:10.100461 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-af62fb62-5fd3-43cb-9d06-e8a78e47ceb9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:10.102239 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-af62fb62-5fd3-43cb-9d06-e8a78e47ceb9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:10.110860 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-af62fb62-5fd3-43cb-9d06-e8a78e47ceb9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:10.111400 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-af62fb62-5fd3-43cb-9d06-e8a78e47ceb9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:10.111994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-af62fb62-5fd3-43cb-9d06-e8a78e47ceb9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:10.112925 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-af62fb62-5fd3-43cb-9d06-e8a78e47ceb9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:10.113419 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-af62fb62-5fd3-43cb-9d06-e8a78e47ceb9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:10.114004 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-af62fb62-5fd3-43cb-9d06-e8a78e47ceb9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:10.330864 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-af62fb62-5fd3-43cb-9d06-e8a78e47ceb9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:10.340246 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-af62fb62-5fd3-43cb-9d06-e8a78e47ceb9 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.244669 Sep 01 17:41:10.340852 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 298/636] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:10 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:41:11.363192 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7fd8387c-4ae1-48c8-8a4f-88981ff2462a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:11.364127 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7fd8387c-4ae1-48c8-8a4f-88981ff2462a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:11.371200 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7fd8387c-4ae1-48c8-8a4f-88981ff2462a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:11.371674 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7fd8387c-4ae1-48c8-8a4f-88981ff2462a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:11.372113 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7fd8387c-4ae1-48c8-8a4f-88981ff2462a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:11.372830 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7fd8387c-4ae1-48c8-8a4f-88981ff2462a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:11.373280 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7fd8387c-4ae1-48c8-8a4f-88981ff2462a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:11.373733 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7fd8387c-4ae1-48c8-8a4f-88981ff2462a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:11.557464 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7fd8387c-4ae1-48c8-8a4f-88981ff2462a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:11.566727 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7fd8387c-4ae1-48c8-8a4f-88981ff2462a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.207859 Sep 01 17:41:11.567327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 339/637] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:11 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:41:12.599445 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-54b38d08-8d0b-44f4-8ff0-704ea8d56e72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:12.600257 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-54b38d08-8d0b-44f4-8ff0-704ea8d56e72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:12.607006 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-54b38d08-8d0b-44f4-8ff0-704ea8d56e72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:12.607494 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-54b38d08-8d0b-44f4-8ff0-704ea8d56e72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:12.607939 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-54b38d08-8d0b-44f4-8ff0-704ea8d56e72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:12.608675 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-54b38d08-8d0b-44f4-8ff0-704ea8d56e72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:12.609138 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-54b38d08-8d0b-44f4-8ff0-704ea8d56e72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:12.609560 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-54b38d08-8d0b-44f4-8ff0-704ea8d56e72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:12.772625 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-54b38d08-8d0b-44f4-8ff0-704ea8d56e72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:12.781856 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-54b38d08-8d0b-44f4-8ff0-704ea8d56e72 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.186314 Sep 01 17:41:12.782456 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 299/638] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:12 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:13.804518 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f3c673c2-7620-466a-9c3e-5ff39bdfdc11 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:13.805110 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f3c673c2-7620-466a-9c3e-5ff39bdfdc11 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:13.811599 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f3c673c2-7620-466a-9c3e-5ff39bdfdc11 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:13.812089 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f3c673c2-7620-466a-9c3e-5ff39bdfdc11 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:13.812532 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f3c673c2-7620-466a-9c3e-5ff39bdfdc11 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:13.813249 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f3c673c2-7620-466a-9c3e-5ff39bdfdc11 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:13.813741 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f3c673c2-7620-466a-9c3e-5ff39bdfdc11 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:13.814159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f3c673c2-7620-466a-9c3e-5ff39bdfdc11 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:13.972430 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f3c673c2-7620-466a-9c3e-5ff39bdfdc11 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:13.980931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f3c673c2-7620-466a-9c3e-5ff39bdfdc11 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.181351 Sep 01 17:41:13.981510 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 340/639] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:13 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:15.002309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c38a026a-b78e-48cd-8d77-a39472efabeb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:15.002925 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c38a026a-b78e-48cd-8d77-a39472efabeb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:15.010124 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c38a026a-b78e-48cd-8d77-a39472efabeb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:15.010609 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c38a026a-b78e-48cd-8d77-a39472efabeb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:15.011041 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c38a026a-b78e-48cd-8d77-a39472efabeb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:15.011732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c38a026a-b78e-48cd-8d77-a39472efabeb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:15.012177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c38a026a-b78e-48cd-8d77-a39472efabeb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:15.012603 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c38a026a-b78e-48cd-8d77-a39472efabeb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:15.164593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c38a026a-b78e-48cd-8d77-a39472efabeb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:15.173842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c38a026a-b78e-48cd-8d77-a39472efabeb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.175331 Sep 01 17:41:15.174422 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 300/640] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:14 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:16.196115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ec2126fb-bfd3-4e5d-a69f-efd9b71b0f4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:16.196852 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ec2126fb-bfd3-4e5d-a69f-efd9b71b0f4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:16.199432 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:16.206493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec2126fb-bfd3-4e5d-a69f-efd9b71b0f4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:16.207004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec2126fb-bfd3-4e5d-a69f-efd9b71b0f4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:16.207431 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec2126fb-bfd3-4e5d-a69f-efd9b71b0f4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:16.208140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec2126fb-bfd3-4e5d-a69f-efd9b71b0f4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:16.209360 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec2126fb-bfd3-4e5d-a69f-efd9b71b0f4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:16.209895 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec2126fb-bfd3-4e5d-a69f-efd9b71b0f4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:16.390860 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ec2126fb-bfd3-4e5d-a69f-efd9b71b0f4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:16.401229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ec2126fb-bfd3-4e5d-a69f-efd9b71b0f4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.209767 Sep 01 17:41:16.401937 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 341/641] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:16 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:17.425685 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-64332dbf-884c-449b-8859-3b22b7b44936 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:17.426310 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-64332dbf-884c-449b-8859-3b22b7b44936 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:17.433662 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-64332dbf-884c-449b-8859-3b22b7b44936 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:17.434155 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-64332dbf-884c-449b-8859-3b22b7b44936 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:17.434599 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-64332dbf-884c-449b-8859-3b22b7b44936 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:17.435305 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-64332dbf-884c-449b-8859-3b22b7b44936 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:17.435792 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-64332dbf-884c-449b-8859-3b22b7b44936 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:17.436221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-64332dbf-884c-449b-8859-3b22b7b44936 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:17.607258 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-64332dbf-884c-449b-8859-3b22b7b44936 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:17.616449 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-64332dbf-884c-449b-8859-3b22b7b44936 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.196849 Sep 01 17:41:17.617036 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 301/642] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:17 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:18.637333 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0e29411e-819b-4587-9db2-25e2f78affea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:18.637974 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0e29411e-819b-4587-9db2-25e2f78affea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:18.644461 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e29411e-819b-4587-9db2-25e2f78affea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:18.644933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e29411e-819b-4587-9db2-25e2f78affea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:18.645361 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e29411e-819b-4587-9db2-25e2f78affea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:18.646288 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e29411e-819b-4587-9db2-25e2f78affea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:18.646942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e29411e-819b-4587-9db2-25e2f78affea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:18.647366 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0e29411e-819b-4587-9db2-25e2f78affea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:18.793504 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0e29411e-819b-4587-9db2-25e2f78affea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:18.801695 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0e29411e-819b-4587-9db2-25e2f78affea tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.168468 Sep 01 17:41:18.802952 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 342/643] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:18 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:19.823440 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-07c04af6-efff-4209-b125-fb7b80024b9b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:19.824026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-07c04af6-efff-4209-b125-fb7b80024b9b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:19.830502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-07c04af6-efff-4209-b125-fb7b80024b9b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:19.831012 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-07c04af6-efff-4209-b125-fb7b80024b9b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:19.831449 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-07c04af6-efff-4209-b125-fb7b80024b9b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:19.832130 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-07c04af6-efff-4209-b125-fb7b80024b9b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:19.832580 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-07c04af6-efff-4209-b125-fb7b80024b9b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:19.833002 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-07c04af6-efff-4209-b125-fb7b80024b9b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:19.981538 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-07c04af6-efff-4209-b125-fb7b80024b9b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:19.990070 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-07c04af6-efff-4209-b125-fb7b80024b9b tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.170539 Sep 01 17:41:19.990735 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 302/644] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:19 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:21.011799 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-746534ad-b34c-4722-87e9-f1ce4af4c57f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:21.012364 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-746534ad-b34c-4722-87e9-f1ce4af4c57f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:21.018751 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-746534ad-b34c-4722-87e9-f1ce4af4c57f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:21.019226 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-746534ad-b34c-4722-87e9-f1ce4af4c57f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:21.019652 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-746534ad-b34c-4722-87e9-f1ce4af4c57f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:21.020329 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-746534ad-b34c-4722-87e9-f1ce4af4c57f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:21.020780 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-746534ad-b34c-4722-87e9-f1ce4af4c57f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:21.021523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-746534ad-b34c-4722-87e9-f1ce4af4c57f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:21.171638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-746534ad-b34c-4722-87e9-f1ce4af4c57f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:21.180257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-746534ad-b34c-4722-87e9-f1ce4af4c57f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.172333 Sep 01 17:41:21.180843 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 343/645] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:21 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:22.201553 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b73444b4-7e64-4bdf-96da-1ea3a53c2383 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:22.202181 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b73444b4-7e64-4bdf-96da-1ea3a53c2383 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:22.208664 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b73444b4-7e64-4bdf-96da-1ea3a53c2383 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:22.209462 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b73444b4-7e64-4bdf-96da-1ea3a53c2383 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:22.209608 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b73444b4-7e64-4bdf-96da-1ea3a53c2383 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:22.210859 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b73444b4-7e64-4bdf-96da-1ea3a53c2383 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:22.210859 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b73444b4-7e64-4bdf-96da-1ea3a53c2383 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:22.211151 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b73444b4-7e64-4bdf-96da-1ea3a53c2383 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:22.271694 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-76787b2e-fe89-42df-b759-00bfb6055736 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:22.273056 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-76787b2e-fe89-42df-b759-00bfb6055736 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:22.279676 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-76787b2e-fe89-42df-b759-00bfb6055736 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:22.280160 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-76787b2e-fe89-42df-b759-00bfb6055736 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:22.280597 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-76787b2e-fe89-42df-b759-00bfb6055736 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:22.281309 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-76787b2e-fe89-42df-b759-00bfb6055736 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:22.281802 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-76787b2e-fe89-42df-b759-00bfb6055736 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:22.282215 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-76787b2e-fe89-42df-b759-00bfb6055736 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:22.381906 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b73444b4-7e64-4bdf-96da-1ea3a53c2383 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:22.385635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-76787b2e-fe89-42df-b759-00bfb6055736 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lazy-loading 'services' on Instance uuid 7f90fd38-f49d-4675-9502-0d9a988ae971 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:41:22.390889 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b73444b4-7e64-4bdf-96da-1ea3a53c2383 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.193138 Sep 01 17:41:22.391564 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 303/646] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:22 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:22.512941 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-76787b2e-fe89-42df-b759-00bfb6055736 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971/os-volume_attachments/1694b0e1-2718-4d87-8768-3291384efdea" status: 202 len: 0 microversion: 2.1 time: 0.244977 Sep 01 17:41:22.513682 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 344/647] 10.222.0.100 () {58 vars in 1421 bytes} [Thu Sep 1 17:41:22 2022] DELETE /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971/os-volume_attachments/1694b0e1-2718-4d87-8768-3291384efdea => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 17:41:23.417393 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e171eb1d-d9ad-429d-8951-487cce906def tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:23.418026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e171eb1d-d9ad-429d-8951-487cce906def tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:23.425134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e171eb1d-d9ad-429d-8951-487cce906def tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:23.425657 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e171eb1d-d9ad-429d-8951-487cce906def tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:23.426151 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e171eb1d-d9ad-429d-8951-487cce906def tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:23.426872 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e171eb1d-d9ad-429d-8951-487cce906def tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:23.427323 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e171eb1d-d9ad-429d-8951-487cce906def tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:23.427887 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e171eb1d-d9ad-429d-8951-487cce906def tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:23.586629 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e171eb1d-d9ad-429d-8951-487cce906def tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:23.595144 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e171eb1d-d9ad-429d-8951-487cce906def tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.185731 Sep 01 17:41:23.596514 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 304/648] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:23 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:24.619508 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-827895e7-4ff3-4793-90c0-bedf299687d2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:24.620287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-827895e7-4ff3-4793-90c0-bedf299687d2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:24.627540 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-827895e7-4ff3-4793-90c0-bedf299687d2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:24.628051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-827895e7-4ff3-4793-90c0-bedf299687d2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:24.628478 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-827895e7-4ff3-4793-90c0-bedf299687d2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:24.629174 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-827895e7-4ff3-4793-90c0-bedf299687d2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:24.629650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-827895e7-4ff3-4793-90c0-bedf299687d2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:24.630601 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-827895e7-4ff3-4793-90c0-bedf299687d2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:24.702041 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bbed2f52-18ff-4b9d-9332-df1150db33c4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:24.702611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bbed2f52-18ff-4b9d-9332-df1150db33c4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:24.708680 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbed2f52-18ff-4b9d-9332-df1150db33c4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:24.709328 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbed2f52-18ff-4b9d-9332-df1150db33c4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:24.709799 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbed2f52-18ff-4b9d-9332-df1150db33c4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:24.710507 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbed2f52-18ff-4b9d-9332-df1150db33c4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:24.711002 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbed2f52-18ff-4b9d-9332-df1150db33c4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:24.711375 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bbed2f52-18ff-4b9d-9332-df1150db33c4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:24.737803 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bbed2f52-18ff-4b9d-9332-df1150db33c4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Going to try to terminate instance {{(pid=127232) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:41:24.785343 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-827895e7-4ff3-4793-90c0-bedf299687d2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:24.797059 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-827895e7-4ff3-4793-90c0-bedf299687d2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.182348 Sep 01 17:41:24.797798 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 345/649] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:24 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:24.833772 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bbed2f52-18ff-4b9d-9332-df1150db33c4 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 204 len: 0 microversion: 2.1 time: 0.134907 Sep 01 17:41:24.834896 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 305/650] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:41:24 2022] DELETE /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 17:41:24.844531 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d740f460-547b-4b4e-8169-298a13b338d2 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:24.845312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d740f460-547b-4b4e-8169-298a13b338d2 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:24.852653 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d740f460-547b-4b4e-8169-298a13b338d2 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:24.853151 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d740f460-547b-4b4e-8169-298a13b338d2 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:24.853611 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d740f460-547b-4b4e-8169-298a13b338d2 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:24.854368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d740f460-547b-4b4e-8169-298a13b338d2 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:24.854830 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d740f460-547b-4b4e-8169-298a13b338d2 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:24.855254 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d740f460-547b-4b4e-8169-298a13b338d2 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:24.995598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d740f460-547b-4b4e-8169-298a13b338d2 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:25.004245 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d740f460-547b-4b4e-8169-298a13b338d2 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1517 microversion: 2.1 time: 0.164273 Sep 01 17:41:25.004833 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 346/651] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:24 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:25.821151 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ea033340-4ad6-4a32-8430-f00c8607bf46 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:25.822016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ea033340-4ad6-4a32-8430-f00c8607bf46 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:25.828505 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ea033340-4ad6-4a32-8430-f00c8607bf46 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:25.828988 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ea033340-4ad6-4a32-8430-f00c8607bf46 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:25.829432 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ea033340-4ad6-4a32-8430-f00c8607bf46 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:25.830147 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ea033340-4ad6-4a32-8430-f00c8607bf46 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:25.830590 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ea033340-4ad6-4a32-8430-f00c8607bf46 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:25.831012 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ea033340-4ad6-4a32-8430-f00c8607bf46 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:25.982244 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ea033340-4ad6-4a32-8430-f00c8607bf46 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:25.991469 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ea033340-4ad6-4a32-8430-f00c8607bf46 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.175731 Sep 01 17:41:25.992056 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 306/652] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:25 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:26.026318 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0b237534-950f-417a-8e19-7db03ad1f319 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:26.026917 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0b237534-950f-417a-8e19-7db03ad1f319 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:26.034239 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0b237534-950f-417a-8e19-7db03ad1f319 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:26.034721 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0b237534-950f-417a-8e19-7db03ad1f319 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:26.035150 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0b237534-950f-417a-8e19-7db03ad1f319 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:26.035874 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0b237534-950f-417a-8e19-7db03ad1f319 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:26.036876 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0b237534-950f-417a-8e19-7db03ad1f319 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:26.037602 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0b237534-950f-417a-8e19-7db03ad1f319 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:26.176665 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0b237534-950f-417a-8e19-7db03ad1f319 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:26.185451 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0b237534-950f-417a-8e19-7db03ad1f319 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1517 microversion: 2.1 time: 0.162974 Sep 01 17:41:26.186064 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 347/653] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:26 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:27.014250 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-faf3f2ef-1944-46f8-9e61-3ce2757aaee5 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:27.015382 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-faf3f2ef-1944-46f8-9e61-3ce2757aaee5 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:27.027936 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-faf3f2ef-1944-46f8-9e61-3ce2757aaee5 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:27.028705 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-faf3f2ef-1944-46f8-9e61-3ce2757aaee5 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:27.029498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-faf3f2ef-1944-46f8-9e61-3ce2757aaee5 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:27.030725 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-faf3f2ef-1944-46f8-9e61-3ce2757aaee5 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:27.031562 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-faf3f2ef-1944-46f8-9e61-3ce2757aaee5 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:27.032339 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-faf3f2ef-1944-46f8-9e61-3ce2757aaee5 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:27.207220 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2653ea3e-765e-40f2-8e33-2940cce4f84b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:27.207835 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2653ea3e-765e-40f2-8e33-2940cce4f84b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:27.214729 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2653ea3e-765e-40f2-8e33-2940cce4f84b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:27.215212 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2653ea3e-765e-40f2-8e33-2940cce4f84b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:27.215639 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2653ea3e-765e-40f2-8e33-2940cce4f84b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:27.216335 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2653ea3e-765e-40f2-8e33-2940cce4f84b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:27.216780 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2653ea3e-765e-40f2-8e33-2940cce4f84b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:27.217484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2653ea3e-765e-40f2-8e33-2940cce4f84b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:27.338823 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-faf3f2ef-1944-46f8-9e61-3ce2757aaee5 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:27.347297 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-faf3f2ef-1944-46f8-9e61-3ce2757aaee5 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.338616 Sep 01 17:41:27.347887 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 307/654] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:27 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:27.433919 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2653ea3e-765e-40f2-8e33-2940cce4f84b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:27.441909 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2653ea3e-765e-40f2-8e33-2940cce4f84b tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1517 microversion: 2.1 time: 0.238550 Sep 01 17:41:27.443367 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 348/655] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:27 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:41:27.573215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-379e00ac-6fce-43e0-bf3d-8ec309c8d19e req-e5f9e204-7fda-4d57-8a4f-63f322d9e873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f90fd38-f49d-4675-9502-0d9a988ae971", "name": "network-vif-deleted", "tag": "421d832d-5d75-423b-bf4b-221cde95e2e3"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:27.584959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-379e00ac-6fce-43e0-bf3d-8ec309c8d19e req-e5f9e204-7fda-4d57-8a4f-63f322d9e873 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:27.585858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-379e00ac-6fce-43e0-bf3d-8ec309c8d19e req-e5f9e204-7fda-4d57-8a4f-63f322d9e873 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:27.586417 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-379e00ac-6fce-43e0-bf3d-8ec309c8d19e req-e5f9e204-7fda-4d57-8a4f-63f322d9e873 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:27.598773 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-379e00ac-6fce-43e0-bf3d-8ec309c8d19e req-e5f9e204-7fda-4d57-8a4f-63f322d9e873 service nova] Creating event network-vif-deleted:421d832d-5d75-423b-bf4b-221cde95e2e3 for instance 7f90fd38-f49d-4675-9502-0d9a988ae971 on hv-cinder-83976 Sep 01 17:41:27.604371 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-379e00ac-6fce-43e0-bf3d-8ec309c8d19e req-e5f9e204-7fda-4d57-8a4f-63f322d9e873 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034830 Sep 01 17:41:27.605030 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 308/656] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:41:28.369380 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-74074944-faa5-438c-9ebb-95b7e256a6eb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:28.369993 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-74074944-faa5-438c-9ebb-95b7e256a6eb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:28.376462 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-74074944-faa5-438c-9ebb-95b7e256a6eb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:28.376955 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-74074944-faa5-438c-9ebb-95b7e256a6eb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:28.377390 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-74074944-faa5-438c-9ebb-95b7e256a6eb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:28.378142 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-74074944-faa5-438c-9ebb-95b7e256a6eb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:28.378590 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-74074944-faa5-438c-9ebb-95b7e256a6eb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:28.379010 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-74074944-faa5-438c-9ebb-95b7e256a6eb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:28.464751 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:28.480865 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:28.482970 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:28.490475 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:28.490967 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:28.491402 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:28.492137 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:28.492594 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:28.493014 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:28.534649 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:28.535136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:28.535640 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:28.536089 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lazy-loading 'fault' on Instance uuid 7f90fd38-f49d-4675-9502-0d9a988ae971 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:41:28.597639 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66366eb7b7044786b23d08676c14670f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6695ac82241740f5ac5f73b4bcdac5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:28.606649 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2435f067-fba4-4365-9fd9-824859981f20 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 200 len: 1312 microversion: 2.1 time: 0.146353 Sep 01 17:41:28.607612 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 309/657] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:28 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:28.640528 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-74074944-faa5-438c-9ebb-95b7e256a6eb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:28.649425 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-74074944-faa5-438c-9ebb-95b7e256a6eb tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1761 microversion: 2.1 time: 0.284835 Sep 01 17:41:28.650053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 349/658] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:28 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1761 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:29.629766 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cb28d068-4d80-4a95-9b3d-a45cbaae0844 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:29.631605 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-cb28d068-4d80-4a95-9b3d-a45cbaae0844 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] [instance: 7f90fd38-f49d-4675-9502-0d9a988ae971] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:29.638095 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cb28d068-4d80-4a95-9b3d-a45cbaae0844 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:29.638642 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cb28d068-4d80-4a95-9b3d-a45cbaae0844 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:29.639133 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cb28d068-4d80-4a95-9b3d-a45cbaae0844 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:29.639892 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cb28d068-4d80-4a95-9b3d-a45cbaae0844 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:29.640342 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cb28d068-4d80-4a95-9b3d-a45cbaae0844 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:29.640755 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cb28d068-4d80-4a95-9b3d-a45cbaae0844 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:29.655202 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-cb28d068-4d80-4a95-9b3d-a45cbaae0844 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] HTTP exception thrown: Instance 7f90fd38-f49d-4675-9502-0d9a988ae971 could not be found. Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cb28d068-4d80-4a95-9b3d-a45cbaae0844 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Request method failure captured: Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 HTTP/1.1 Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO4Rb6B2-RuOkdTUqAqiQwRQIomnkkU5U4y_uyW-pUBfsoXlsrDSxxz4G-eKNCSdrtPfGmzxJ9e9Hr8IHIPvPbILuleY6ZIDQq7ENZPoi8u5GHL1HkN6lNllklNiwtkrfkQQNaiSqPwWTc1X53GkqqnD1ZYbAjvHGdEbmAJ7mlTlcKI Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 6695ac82241740f5ac5f73b4bcdac5f5 Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-VolumesSnapshotTestJSON-572627331 Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:41:29.656955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:41:29.658334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/6695ac82241740f5ac5f73b4bcdac5f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/6695ac82241740f5ac5f73b4bcdac5f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_6695ac82241740f5ac5f73b4bcdac5f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/6695ac82241740f5ac5f73b4bcdac5f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:41:29.658334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-VolumesSnapshotTestJSON-572627331 Sep 01 17:41:29.658334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 6695ac82241740f5ac5f73b4bcdac5f5 Sep 01 17:41:29.658334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-572627331 Sep 01 17:41:29.658334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-VolumesSnapshotTestJSON-572627331-project Sep 01 17:41:29.658334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:41:29.658334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:41:29.658334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: 66366eb7b7044786b23d08676c14670f Sep 01 17:41:29.658334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-VolumesSnapshotTestJSON-572627331-project Sep 01 17:41:29.658334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:41:29.658334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 7f90fd38-f49d-4675-9502-0d9a988ae971 could not be found. Sep 01 17:41:29.658334 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '7f90fd38-f49d-4675-9502-0d9a988ae971'} Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f90fd38-f49d-4675-9502-0d9a988ae971 could not be found. Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:41:29.659083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f90fd38-f49d-4675-9502-0d9a988ae971 could not be found. Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f90fd38-f49d-4675-9502-0d9a988ae971 could not be found. Sep 01 17:41:29.660516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:41:29.661917 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cb28d068-4d80-4a95-9b3d-a45cbaae0844 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] Returning 404 to user: Instance 7f90fd38-f49d-4675-9502-0d9a988ae971 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:41:29.661917 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-cb28d068-4d80-4a95-9b3d-a45cbaae0844 tempest-VolumesSnapshotTestJSON-572627331 tempest-VolumesSnapshotTestJSON-572627331-project] 10.222.0.100 "GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971" status: 404 len: 111 microversion: 2.1 time: 0.032651 Sep 01 17:41:29.661917 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 310/659] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:29 2022] GET /compute/v2.1/servers/7f90fd38-f49d-4675-9502-0d9a988ae971 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:41:29.671356 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-19c7d6c1-6559-43c9-822f-7a0b5cb64176 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:29.672279 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-19c7d6c1-6559-43c9-822f-7a0b5cb64176 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:29.679706 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-19c7d6c1-6559-43c9-822f-7a0b5cb64176 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:29.680200 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-19c7d6c1-6559-43c9-822f-7a0b5cb64176 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:29.680640 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-19c7d6c1-6559-43c9-822f-7a0b5cb64176 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:29.681336 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-19c7d6c1-6559-43c9-822f-7a0b5cb64176 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:29.682382 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-19c7d6c1-6559-43c9-822f-7a0b5cb64176 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:29.682382 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-19c7d6c1-6559-43c9-822f-7a0b5cb64176 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:29.834808 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-19c7d6c1-6559-43c9-822f-7a0b5cb64176 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:29.843364 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-19c7d6c1-6559-43c9-822f-7a0b5cb64176 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1764 microversion: 2.1 time: 0.176345 Sep 01 17:41:29.843948 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 350/660] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:29 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1764 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:38.394014 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-20721d15-b87e-442b-b4e8-b0ec46539e7c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:38.394635 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-20721d15-b87e-442b-b4e8-b0ec46539e7c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:38.401206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-20721d15-b87e-442b-b4e8-b0ec46539e7c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:38.401791 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-20721d15-b87e-442b-b4e8-b0ec46539e7c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:38.402233 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-20721d15-b87e-442b-b4e8-b0ec46539e7c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:38.402970 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-20721d15-b87e-442b-b4e8-b0ec46539e7c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:38.403375 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-20721d15-b87e-442b-b4e8-b0ec46539e7c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:38.403799 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-20721d15-b87e-442b-b4e8-b0ec46539e7c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:38.407443 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:38.435887 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-20721d15-b87e-442b-b4e8-b0ec46539e7c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments/d94c0e66-e1c2-467a-ac17-36c6b423ddec" status: 200 len: 194 microversion: 2.20 time: 0.045863 Sep 01 17:41:38.436461 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 311/661] 10.222.0.100 () {60 vars in 1459 bytes} [Thu Sep 1 17:41:38 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments/d94c0e66-e1c2-467a-ac17-36c6b423ddec => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:41:38.504469 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5cf8c522-262f-461d-a275-8410f8c1297d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:38.505750 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5cf8c522-262f-461d-a275-8410f8c1297d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:38.512419 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5cf8c522-262f-461d-a275-8410f8c1297d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:38.512913 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5cf8c522-262f-461d-a275-8410f8c1297d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:38.513345 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5cf8c522-262f-461d-a275-8410f8c1297d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:38.514071 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5cf8c522-262f-461d-a275-8410f8c1297d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:38.514527 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5cf8c522-262f-461d-a275-8410f8c1297d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:38.514948 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5cf8c522-262f-461d-a275-8410f8c1297d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:38.598048 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-5cf8c522-262f-461d-a275-8410f8c1297d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lazy-loading 'services' on Instance uuid 7fc52ad3-09b3-4851-8a50-ad446bd1a75d {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:41:38.669747 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5cf8c522-262f-461d-a275-8410f8c1297d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments/d94c0e66-e1c2-467a-ac17-36c6b423ddec" status: 202 len: 0 microversion: 2.20 time: 0.169079 Sep 01 17:41:38.670350 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 351/662] 10.222.0.100 () {60 vars in 1462 bytes} [Thu Sep 1 17:41:38 2022] DELETE /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments/d94c0e66-e1c2-467a-ac17-36c6b423ddec => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:41:38.679132 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-606dd1cf-490e-454a-a46c-bbda76e58f7b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:38.681385 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-606dd1cf-490e-454a-a46c-bbda76e58f7b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:38.687312 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-606dd1cf-490e-454a-a46c-bbda76e58f7b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:38.687808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-606dd1cf-490e-454a-a46c-bbda76e58f7b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:38.688312 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-606dd1cf-490e-454a-a46c-bbda76e58f7b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:38.689103 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-606dd1cf-490e-454a-a46c-bbda76e58f7b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:38.689501 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-606dd1cf-490e-454a-a46c-bbda76e58f7b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:38.689945 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-606dd1cf-490e-454a-a46c-bbda76e58f7b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:38.725213 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-606dd1cf-490e-454a-a46c-bbda76e58f7b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050025 Sep 01 17:41:38.726007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 312/663] 10.222.0.100 () {60 vars in 1348 bytes} [Thu Sep 1 17:41:38 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:41:39.739846 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0df1a81e-1db6-4cc8-8193-523a1641cd35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:39.742312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0df1a81e-1db6-4cc8-8193-523a1641cd35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:39.748721 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0df1a81e-1db6-4cc8-8193-523a1641cd35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:39.749203 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0df1a81e-1db6-4cc8-8193-523a1641cd35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:39.749666 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0df1a81e-1db6-4cc8-8193-523a1641cd35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:39.750360 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0df1a81e-1db6-4cc8-8193-523a1641cd35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:39.750814 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0df1a81e-1db6-4cc8-8193-523a1641cd35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:39.751231 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0df1a81e-1db6-4cc8-8193-523a1641cd35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:39.782078 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0df1a81e-1db6-4cc8-8193-523a1641cd35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047626 Sep 01 17:41:39.782646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 352/664] 10.222.0.100 () {60 vars in 1348 bytes} [Thu Sep 1 17:41:39 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:41:40.795731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-45ae7110-184c-436d-82ac-39ba559dc5a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:40.797816 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-45ae7110-184c-436d-82ac-39ba559dc5a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:40.805364 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-45ae7110-184c-436d-82ac-39ba559dc5a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:40.805874 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-45ae7110-184c-436d-82ac-39ba559dc5a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:40.806307 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-45ae7110-184c-436d-82ac-39ba559dc5a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:40.806991 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-45ae7110-184c-436d-82ac-39ba559dc5a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:40.807436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-45ae7110-184c-436d-82ac-39ba559dc5a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:40.807953 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-45ae7110-184c-436d-82ac-39ba559dc5a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:40.838883 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-45ae7110-184c-436d-82ac-39ba559dc5a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047200 Sep 01 17:41:40.839421 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 313/665] 10.222.0.100 () {60 vars in 1348 bytes} [Thu Sep 1 17:41:40 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:41:41.852353 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-05132f7d-0ab9-4eec-bac9-4492df1f717c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:41.854419 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-05132f7d-0ab9-4eec-bac9-4492df1f717c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:41.860644 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05132f7d-0ab9-4eec-bac9-4492df1f717c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:41.861127 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05132f7d-0ab9-4eec-bac9-4492df1f717c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:41.861559 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05132f7d-0ab9-4eec-bac9-4492df1f717c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:41.862281 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05132f7d-0ab9-4eec-bac9-4492df1f717c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:41.862732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05132f7d-0ab9-4eec-bac9-4492df1f717c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:41.863151 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05132f7d-0ab9-4eec-bac9-4492df1f717c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:41.866484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:41.896823 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-05132f7d-0ab9-4eec-bac9-4492df1f717c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049399 Sep 01 17:41:41.897542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 353/666] 10.222.0.100 () {60 vars in 1348 bytes} [Thu Sep 1 17:41:41 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:41:42.909950 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cbf83aa1-ad51-4a62-bab9-7b79d81803ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:42.912536 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-cbf83aa1-ad51-4a62-bab9-7b79d81803ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:42.920003 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbf83aa1-ad51-4a62-bab9-7b79d81803ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:42.920488 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbf83aa1-ad51-4a62-bab9-7b79d81803ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:42.920923 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbf83aa1-ad51-4a62-bab9-7b79d81803ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:42.921749 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbf83aa1-ad51-4a62-bab9-7b79d81803ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:42.922282 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbf83aa1-ad51-4a62-bab9-7b79d81803ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:42.922632 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbf83aa1-ad51-4a62-bab9-7b79d81803ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:42.953224 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-cbf83aa1-ad51-4a62-bab9-7b79d81803ec tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047465 Sep 01 17:41:42.953812 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 314/667] 10.222.0.100 () {60 vars in 1348 bytes} [Thu Sep 1 17:41:42 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:43.020909 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-71225a1d-df80-4bf6-81e0-f1126b6a8cfb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:43.021467 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-71225a1d-df80-4bf6-81e0-f1126b6a8cfb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:43.027974 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-71225a1d-df80-4bf6-81e0-f1126b6a8cfb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:43.028455 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-71225a1d-df80-4bf6-81e0-f1126b6a8cfb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:43.028886 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-71225a1d-df80-4bf6-81e0-f1126b6a8cfb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:43.029597 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-71225a1d-df80-4bf6-81e0-f1126b6a8cfb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:43.030051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-71225a1d-df80-4bf6-81e0-f1126b6a8cfb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:43.030473 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-71225a1d-df80-4bf6-81e0-f1126b6a8cfb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:43.056369 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-71225a1d-df80-4bf6-81e0-f1126b6a8cfb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Going to try to terminate instance {{(pid=127233) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:41:43.133529 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-71225a1d-df80-4bf6-81e0-f1126b6a8cfb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 204 len: 0 microversion: 2.20 time: 0.116443 Sep 01 17:41:43.134177 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 354/668] 10.222.0.100 () {60 vars in 1285 bytes} [Thu Sep 1 17:41:43 2022] DELETE /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 17:41:43.143959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e92e5a0b-9cd1-4d6a-86f0-c308864e0641 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:43.144627 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e92e5a0b-9cd1-4d6a-86f0-c308864e0641 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:43.153624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e92e5a0b-9cd1-4d6a-86f0-c308864e0641 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:43.154444 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e92e5a0b-9cd1-4d6a-86f0-c308864e0641 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:43.155194 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e92e5a0b-9cd1-4d6a-86f0-c308864e0641 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:43.156402 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e92e5a0b-9cd1-4d6a-86f0-c308864e0641 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:43.157197 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e92e5a0b-9cd1-4d6a-86f0-c308864e0641 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:43.158001 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e92e5a0b-9cd1-4d6a-86f0-c308864e0641 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:43.355323 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e92e5a0b-9cd1-4d6a-86f0-c308864e0641 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:43.364601 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e92e5a0b-9cd1-4d6a-86f0-c308864e0641 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:43.366124 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e92e5a0b-9cd1-4d6a-86f0-c308864e0641 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:43.367308 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e92e5a0b-9cd1-4d6a-86f0-c308864e0641 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.228348 Sep 01 17:41:43.367873 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 315/669] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:43 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:43.897499 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ec646d3e-87ba-4e6b-8820-cf0912c9c3bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:43.898386 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ec646d3e-87ba-4e6b-8820-cf0912c9c3bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:43.904704 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec646d3e-87ba-4e6b-8820-cf0912c9c3bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:43.905197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec646d3e-87ba-4e6b-8820-cf0912c9c3bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:43.905732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec646d3e-87ba-4e6b-8820-cf0912c9c3bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:43.906461 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec646d3e-87ba-4e6b-8820-cf0912c9c3bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:43.906962 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec646d3e-87ba-4e6b-8820-cf0912c9c3bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:43.907391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ec646d3e-87ba-4e6b-8820-cf0912c9c3bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:43.932732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ec646d3e-87ba-4e6b-8820-cf0912c9c3bf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da/ips" status: 200 len: 151 microversion: 2.1 time: 0.039731 Sep 01 17:41:43.933311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 355/670] 10.222.0.100 () {58 vars in 1253 bytes} [Thu Sep 1 17:41:43 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:41:43.945665 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a646f83d-ca6c-46f5-8e9f-f1f0e3888050 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc8b29da-ae5b-4b92-ac27-b28723b25434"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:43.947897 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a646f83d-ca6c-46f5-8e9f-f1f0e3888050 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:43.954433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a646f83d-ca6c-46f5-8e9f-f1f0e3888050 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:43.955001 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a646f83d-ca6c-46f5-8e9f-f1f0e3888050 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:43.955440 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a646f83d-ca6c-46f5-8e9f-f1f0e3888050 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:43.956137 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a646f83d-ca6c-46f5-8e9f-f1f0e3888050 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:43.956593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a646f83d-ca6c-46f5-8e9f-f1f0e3888050 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:43.957018 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a646f83d-ca6c-46f5-8e9f-f1f0e3888050 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:44.038128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-a646f83d-ca6c-46f5-8e9f-f1f0e3888050 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Invalid volume: volume bc8b29da-ae5b-4b92-ac27-b28723b25434 is already attached to instances: 48752724-82dc-4307-98af-ccc606bf5ca0 Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a646f83d-ca6c-46f5-8e9f-f1f0e3888050 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: POST /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da/os-volume_attachments HTTP/1.1 Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 74 Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:41:44.040007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:41:44.041648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:41:44.041648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:41:44.041648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:41:44.041648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:41:44.041648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:41:44.041648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:41:44.041648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:41:44.041648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:41:44.041648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:41:44.041648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Sep 01 17:41:44.041648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {"volumeAttachment": {"volumeId": "bc8b29da-ae5b-4b92-ac27-b28723b25434"}} Sep 01 17:41:44.041648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Invalid volume: volume bc8b29da-ae5b-4b92-ac27-b28723b25434 is already attached to instances: 48752724-82dc-4307-98af-ccc606bf5ca0 Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'server_id': '92e176cb-aabb-40b5-a79d-acf5d061b2da', 'body': {'volumeAttachment': {'volumeId': 'bc8b29da-ae5b-4b92-ac27-b28723b25434'}}} Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bc8b29da-ae5b-4b92-ac27-b28723b25434 is already attached to instances: 48752724-82dc-4307-98af-ccc606bf5ca0 Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:41:44.042593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bc8b29da-ae5b-4b92-ac27-b28723b25434 is already attached to instances: 48752724-82dc-4307-98af-ccc606bf5ca0 Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:41:44.044026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:41:44.045924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:41:44.045924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:41:44.045924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:41:44.045924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bc8b29da-ae5b-4b92-ac27-b28723b25434 is already attached to instances: 48752724-82dc-4307-98af-ccc606bf5ca0 Sep 01 17:41:44.045924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:41:44.045924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a646f83d-ca6c-46f5-8e9f-f1f0e3888050 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 400 to user: Invalid volume: volume bc8b29da-ae5b-4b92-ac27-b28723b25434 is already attached to instances: 48752724-82dc-4307-98af-ccc606bf5ca0 {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:41:44.045924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a646f83d-ca6c-46f5-8e9f-f1f0e3888050 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "POST /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100801 Sep 01 17:41:44.045924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 316/671] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:41:43 2022] POST /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:41:44.050196 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cedcecdc-acfa-4854-b8bd-dbdf86308598 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:44.050750 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cedcecdc-acfa-4854-b8bd-dbdf86308598 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:44.058070 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cedcecdc-acfa-4854-b8bd-dbdf86308598 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:44.058557 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cedcecdc-acfa-4854-b8bd-dbdf86308598 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:44.058994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cedcecdc-acfa-4854-b8bd-dbdf86308598 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:44.059689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cedcecdc-acfa-4854-b8bd-dbdf86308598 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:44.060147 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cedcecdc-acfa-4854-b8bd-dbdf86308598 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:44.060573 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cedcecdc-acfa-4854-b8bd-dbdf86308598 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:44.086207 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cedcecdc-acfa-4854-b8bd-dbdf86308598 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Going to try to terminate instance {{(pid=127233) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:41:44.162837 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cedcecdc-acfa-4854-b8bd-dbdf86308598 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 204 len: 0 microversion: 2.1 time: 0.116204 Sep 01 17:41:44.163418 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 356/672] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:41:44 2022] DELETE /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 17:41:44.172199 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c5671576-be15-4992-90bd-6039ad4584c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:44.172837 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c5671576-be15-4992-90bd-6039ad4584c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:44.180610 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c5671576-be15-4992-90bd-6039ad4584c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:44.181097 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c5671576-be15-4992-90bd-6039ad4584c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:44.181535 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c5671576-be15-4992-90bd-6039ad4584c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:44.182243 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c5671576-be15-4992-90bd-6039ad4584c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:44.182710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c5671576-be15-4992-90bd-6039ad4584c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:44.183117 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c5671576-be15-4992-90bd-6039ad4584c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:44.313789 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c5671576-be15-4992-90bd-6039ad4584c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:44.323449 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c5671576-be15-4992-90bd-6039ad4584c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1683 microversion: 2.1 time: 0.155245 Sep 01 17:41:44.324078 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 317/673] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:44 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:44.391142 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-25264444-0446-4f00-9244-4109fdd85b90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:44.391820 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-25264444-0446-4f00-9244-4109fdd85b90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:44.398250 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-25264444-0446-4f00-9244-4109fdd85b90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:44.398733 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-25264444-0446-4f00-9244-4109fdd85b90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:44.399163 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-25264444-0446-4f00-9244-4109fdd85b90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:44.399853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-25264444-0446-4f00-9244-4109fdd85b90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:44.400303 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-25264444-0446-4f00-9244-4109fdd85b90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:44.400719 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-25264444-0446-4f00-9244-4109fdd85b90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:44.533914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-25264444-0446-4f00-9244-4109fdd85b90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:44.543085 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-25264444-0446-4f00-9244-4109fdd85b90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:44.544521 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-25264444-0446-4f00-9244-4109fdd85b90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:44.545707 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-25264444-0446-4f00-9244-4109fdd85b90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.158897 Sep 01 17:41:44.546270 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 357/674] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:44 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:45.346459 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-473aa915-eb85-428a-9cfe-27b5f7624d64 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:45.346978 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-473aa915-eb85-428a-9cfe-27b5f7624d64 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:45.353800 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-473aa915-eb85-428a-9cfe-27b5f7624d64 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:45.354407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-473aa915-eb85-428a-9cfe-27b5f7624d64 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:45.354907 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-473aa915-eb85-428a-9cfe-27b5f7624d64 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:45.355711 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-473aa915-eb85-428a-9cfe-27b5f7624d64 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:45.356204 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-473aa915-eb85-428a-9cfe-27b5f7624d64 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:45.356711 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-473aa915-eb85-428a-9cfe-27b5f7624d64 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:45.511543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-473aa915-eb85-428a-9cfe-27b5f7624d64 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:45.519768 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-473aa915-eb85-428a-9cfe-27b5f7624d64 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1683 microversion: 2.1 time: 0.177384 Sep 01 17:41:45.520360 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 318/675] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:45 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:45.569946 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-61700035-31a4-406a-8362-8ae7cc3ba48f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:45.570592 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-61700035-31a4-406a-8362-8ae7cc3ba48f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:45.577467 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-61700035-31a4-406a-8362-8ae7cc3ba48f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:45.577800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-61700035-31a4-406a-8362-8ae7cc3ba48f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:45.578299 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-61700035-31a4-406a-8362-8ae7cc3ba48f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:45.578906 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-61700035-31a4-406a-8362-8ae7cc3ba48f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:45.579360 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-61700035-31a4-406a-8362-8ae7cc3ba48f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:45.579780 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-61700035-31a4-406a-8362-8ae7cc3ba48f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:45.713236 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-61700035-31a4-406a-8362-8ae7cc3ba48f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:45.721496 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-61700035-31a4-406a-8362-8ae7cc3ba48f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:45.722970 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-61700035-31a4-406a-8362-8ae7cc3ba48f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:45.724646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-61700035-31a4-406a-8362-8ae7cc3ba48f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.158323 Sep 01 17:41:45.725383 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 358/676] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:45 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:46.541934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b505c2ee-b4d3-4a8a-a3b1-83fbf11da81c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:46.543596 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b505c2ee-b4d3-4a8a-a3b1-83fbf11da81c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:46.550104 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b505c2ee-b4d3-4a8a-a3b1-83fbf11da81c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:46.550920 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b505c2ee-b4d3-4a8a-a3b1-83fbf11da81c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:46.551440 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b505c2ee-b4d3-4a8a-a3b1-83fbf11da81c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:46.552297 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b505c2ee-b4d3-4a8a-a3b1-83fbf11da81c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:46.552847 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b505c2ee-b4d3-4a8a-a3b1-83fbf11da81c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:46.553422 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b505c2ee-b4d3-4a8a-a3b1-83fbf11da81c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:46.749546 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-80de7f86-8b2f-4f41-9ab8-aa388f0cd4a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:46.750226 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-80de7f86-8b2f-4f41-9ab8-aa388f0cd4a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:46.752675 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:46.760040 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-80de7f86-8b2f-4f41-9ab8-aa388f0cd4a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:46.760847 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-80de7f86-8b2f-4f41-9ab8-aa388f0cd4a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:46.761280 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-80de7f86-8b2f-4f41-9ab8-aa388f0cd4a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:46.762018 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-80de7f86-8b2f-4f41-9ab8-aa388f0cd4a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:46.762622 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-80de7f86-8b2f-4f41-9ab8-aa388f0cd4a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:46.763190 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-80de7f86-8b2f-4f41-9ab8-aa388f0cd4a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:47.243176 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b505c2ee-b4d3-4a8a-a3b1-83fbf11da81c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:47.253291 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b505c2ee-b4d3-4a8a-a3b1-83fbf11da81c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1683 microversion: 2.1 time: 0.716380 Sep 01 17:41:47.254181 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 319/677] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:46 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1683 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:47.468293 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-80de7f86-8b2f-4f41-9ab8-aa388f0cd4a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:47.480712 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-80de7f86-8b2f-4f41-9ab8-aa388f0cd4a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:47.483005 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-80de7f86-8b2f-4f41-9ab8-aa388f0cd4a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:47.484588 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-80de7f86-8b2f-4f41-9ab8-aa388f0cd4a5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1728 microversion: 2.20 time: 0.740090 Sep 01 17:41:47.494177 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 359/678] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:46 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1728 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:41:47.638472 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-4958abfd-5238-4c35-a2eb-e303bdab94ab req-f3913fd3-fcbb-47d2-8698-044795671211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e176cb-aabb-40b5-a79d-acf5d061b2da", "name": "network-vif-deleted", "tag": "5be3ac5e-b565-42ad-abf6-c17408c0347c"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:47.652769 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-4958abfd-5238-4c35-a2eb-e303bdab94ab req-f3913fd3-fcbb-47d2-8698-044795671211 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:47.654253 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-4958abfd-5238-4c35-a2eb-e303bdab94ab req-f3913fd3-fcbb-47d2-8698-044795671211 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:47.655076 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-4958abfd-5238-4c35-a2eb-e303bdab94ab req-f3913fd3-fcbb-47d2-8698-044795671211 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:47.689431 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-4958abfd-5238-4c35-a2eb-e303bdab94ab req-f3913fd3-fcbb-47d2-8698-044795671211 service nova] Creating event network-vif-deleted:5be3ac5e-b565-42ad-abf6-c17408c0347c for instance 92e176cb-aabb-40b5-a79d-acf5d061b2da on hv-cinder-83976 Sep 01 17:41:47.695903 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-4958abfd-5238-4c35-a2eb-e303bdab94ab req-f3913fd3-fcbb-47d2-8698-044795671211 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062653 Sep 01 17:41:47.700406 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 320/679] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:41:48.283074 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:48.287706 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:48.301541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:48.303387 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:48.304436 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:48.305995 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:48.307128 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:48.308089 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:48.353240 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:48.354222 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:48.354860 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:48.355517 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lazy-loading 'fault' on Instance uuid 92e176cb-aabb-40b5-a79d-acf5d061b2da {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:41:48.442139 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:48.456789 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d6c65abf-c7d5-44a4-80d9-86c75c00853a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 200 len: 1333 microversion: 2.1 time: 0.180461 Sep 01 17:41:48.458170 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 360/680] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:48 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 1333 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:41:48.516501 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-70f4f19a-b4a9-413d-8448-f1a302f298e0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:48.517150 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-70f4f19a-b4a9-413d-8448-f1a302f298e0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:48.535716 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-70f4f19a-b4a9-413d-8448-f1a302f298e0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:48.536230 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-70f4f19a-b4a9-413d-8448-f1a302f298e0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:48.536900 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-70f4f19a-b4a9-413d-8448-f1a302f298e0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:48.541457 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-70f4f19a-b4a9-413d-8448-f1a302f298e0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:48.542188 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-70f4f19a-b4a9-413d-8448-f1a302f298e0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:48.542768 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-70f4f19a-b4a9-413d-8448-f1a302f298e0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:48.551564 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-59572e0e-7201-4997-8e25-f90f4c63aa39 req-46ca5ca8-b0e3-4bd6-89f9-3ddb9158e9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc52ad3-09b3-4851-8a50-ad446bd1a75d", "name": "network-vif-deleted", "tag": "be99e7bf-5f6d-42df-82e3-b77a04fd7684"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:48.572881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-59572e0e-7201-4997-8e25-f90f4c63aa39 req-46ca5ca8-b0e3-4bd6-89f9-3ddb9158e9b2 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:48.573383 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-59572e0e-7201-4997-8e25-f90f4c63aa39 req-46ca5ca8-b0e3-4bd6-89f9-3ddb9158e9b2 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:48.573852 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-59572e0e-7201-4997-8e25-f90f4c63aa39 req-46ca5ca8-b0e3-4bd6-89f9-3ddb9158e9b2 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:48.604729 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-59572e0e-7201-4997-8e25-f90f4c63aa39 req-46ca5ca8-b0e3-4bd6-89f9-3ddb9158e9b2 service nova] Creating event network-vif-deleted:be99e7bf-5f6d-42df-82e3-b77a04fd7684 for instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d on hv-cinder-83976 Sep 01 17:41:48.624119 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-59572e0e-7201-4997-8e25-f90f4c63aa39 req-46ca5ca8-b0e3-4bd6-89f9-3ddb9158e9b2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072716 Sep 01 17:41:48.627540 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 361/681] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:41:48.708136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-70f4f19a-b4a9-413d-8448-f1a302f298e0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:48.731912 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-70f4f19a-b4a9-413d-8448-f1a302f298e0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:48.733695 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-70f4f19a-b4a9-413d-8448-f1a302f298e0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:48.738557 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-70f4f19a-b4a9-413d-8448-f1a302f298e0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 200 len: 1660 microversion: 2.20 time: 0.224194 Sep 01 17:41:48.758312 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 321/682] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:48 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 1660 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:49.480390 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8f4ac4d1-2142-4f37-a7ce-56061d83adfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:49.481832 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8f4ac4d1-2142-4f37-a7ce-56061d83adfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:49.489234 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f4ac4d1-2142-4f37-a7ce-56061d83adfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:49.489761 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f4ac4d1-2142-4f37-a7ce-56061d83adfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:49.490381 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f4ac4d1-2142-4f37-a7ce-56061d83adfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:49.491282 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f4ac4d1-2142-4f37-a7ce-56061d83adfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:49.491901 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f4ac4d1-2142-4f37-a7ce-56061d83adfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:49.492481 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8f4ac4d1-2142-4f37-a7ce-56061d83adfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:49.512721 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-8f4ac4d1-2142-4f37-a7ce-56061d83adfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8f4ac4d1-2142-4f37-a7ce-56061d83adfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da HTTP/1.1 Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:41:49.516829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:41:49.518454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:41:49.518454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:41:49.518454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:41:49.518454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:41:49.518454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:41:49.518454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:41:49.518454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:41:49.518454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:41:49.518454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:41:49.518454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:41:49.518454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:41:49.518454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '92e176cb-aabb-40b5-a79d-acf5d061b2da'} Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:41:49.519291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:41:49.520505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:41:49.524299 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8f4ac4d1-2142-4f37-a7ce-56061d83adfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 404 to user: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:41:49.525778 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8f4ac4d1-2142-4f37-a7ce-56061d83adfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 404 len: 111 microversion: 2.1 time: 0.050253 Sep 01 17:41:49.526699 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 362/683] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:49 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 17:41:49.535576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4e3e5eab-0ba8-4d36-8d58-5ee117afff31 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '.version_select at 0x7f354a62f790>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:49.565082 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4e3e5eab-0ba8-4d36-8d58-5ee117afff31 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-961420263" status: 202 len: 0 microversion: 2.1 time: 0.033247 Sep 01 17:41:49.565914 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 322/684] 10.222.0.100 () {58 vars in 1223 bytes} [Thu Sep 1 17:41:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-961420263 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:41:49.762692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4a1e0a76-a524-4885-bc1b-d5640d9de61b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:49.763305 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4a1e0a76-a524-4885-bc1b-d5640d9de61b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:49.772197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a1e0a76-a524-4885-bc1b-d5640d9de61b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:49.772683 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a1e0a76-a524-4885-bc1b-d5640d9de61b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:49.773116 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a1e0a76-a524-4885-bc1b-d5640d9de61b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:49.781994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a1e0a76-a524-4885-bc1b-d5640d9de61b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:49.782495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a1e0a76-a524-4885-bc1b-d5640d9de61b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:49.782933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4a1e0a76-a524-4885-bc1b-d5640d9de61b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:49.805910 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-4a1e0a76-a524-4885-bc1b-d5640d9de61b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] HTTP exception thrown: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4a1e0a76-a524-4885-bc1b-d5640d9de61b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Request method failure captured: Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d HTTP/1.1 Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2ta67Nt658ECETsKDQS04ve5Vd2ka7ziEOrDDh7dgSRR_4b-zuSksHOlqvLrEhorWM1hSUE7fVgvXOh7amlHLg-PZnGTr65yzpjjpYuXpe7oHgqWCWlCBx5IFgj-nmVvTVG35MBSv921-bTQhUZQ6f28pEdb6Oq5cPSktLuvvxsmM Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: e11b8d4a14a9460eb4ce9967f86e4757 Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:41:49.807450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:41:49.808892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:41:49.808892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:41:49.808892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: e11b8d4a14a9460eb4ce9967f86e4757 Sep 01 17:41:49.808892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:41:49.808892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-AttachVolumeShelveTestJSON-1402317429-project Sep 01 17:41:49.808892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:41:49.808892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:41:49.808892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: bcc538bc852f404699d91d17023ae620 Sep 01 17:41:49.808892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1402317429-project Sep 01 17:41:49.808892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:41:49.808892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:41:49.808892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '7fc52ad3-09b3-4851-8a50-ad446bd1a75d'} Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:41:49.809693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:41:49.810853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:41:49.811951 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4a1e0a76-a524-4885-bc1b-d5640d9de61b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Returning 404 to user: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:41:49.811951 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4a1e0a76-a524-4885-bc1b-d5640d9de61b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 404 len: 111 microversion: 2.20 time: 0.050128 Sep 01 17:41:49.811951 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 363/685] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:49 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 17:41:49.820880 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-503fbb04-9d33-4a7b-93ce-92a1bda82f39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '.version_select at 0x7f354a70aaf0>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:49.849078 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-503fbb04-9d33-4a7b-93ce-92a1bda82f39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014964786" status: 204 len: 0 microversion: 2.20 time: 0.033394 Sep 01 17:41:49.851247 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 323/686] 10.222.0.100 () {60 vars in 1267 bytes} [Thu Sep 1 17:41:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014964786 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 17:41:50.327787 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-540c7321-a26b-42a5-a67d-c2525b2ecd10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:50.328509 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-540c7321-a26b-42a5-a67d-c2525b2ecd10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:50.335172 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-540c7321-a26b-42a5-a67d-c2525b2ecd10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:50.335899 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-540c7321-a26b-42a5-a67d-c2525b2ecd10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:50.336362 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-540c7321-a26b-42a5-a67d-c2525b2ecd10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:50.337230 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-540c7321-a26b-42a5-a67d-c2525b2ecd10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:50.337873 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-540c7321-a26b-42a5-a67d-c2525b2ecd10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:50.338450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-540c7321-a26b-42a5-a67d-c2525b2ecd10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:50.464555 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-540c7321-a26b-42a5-a67d-c2525b2ecd10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lazy-loading 'services' on Instance uuid fd635ada-9195-43da-a0a3-b131c9132dd6 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:41:50.598969 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-540c7321-a26b-42a5-a67d-c2525b2ecd10 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "DELETE /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-volume_attachments/044dacc7-9c15-4894-9825-15127b94aa9f" status: 202 len: 0 microversion: 2.1 time: 0.274056 Sep 01 17:41:50.600546 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 364/687] 10.222.0.100 () {58 vars in 1421 bytes} [Thu Sep 1 17:41:50 2022] DELETE /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-volume_attachments/044dacc7-9c15-4894-9825-15127b94aa9f => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:41:50.610652 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4ead2305-7407-4b82-bebf-c533fe413a3c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:50.613107 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4ead2305-7407-4b82-bebf-c533fe413a3c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:50.629923 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4ead2305-7407-4b82-bebf-c533fe413a3c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:50.633366 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4ead2305-7407-4b82-bebf-c533fe413a3c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:50.634754 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4ead2305-7407-4b82-bebf-c533fe413a3c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:50.636541 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4ead2305-7407-4b82-bebf-c533fe413a3c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:50.637818 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4ead2305-7407-4b82-bebf-c533fe413a3c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:50.639552 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4ead2305-7407-4b82-bebf-c533fe413a3c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:50.641980 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5e00e57a-4e01-4485-84da-1995257190df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:50.642562 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5e00e57a-4e01-4485-84da-1995257190df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:50.650348 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e00e57a-4e01-4485-84da-1995257190df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:50.651537 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e00e57a-4e01-4485-84da-1995257190df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:50.652172 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e00e57a-4e01-4485-84da-1995257190df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:50.653123 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e00e57a-4e01-4485-84da-1995257190df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:50.653640 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e00e57a-4e01-4485-84da-1995257190df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:50.654276 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e00e57a-4e01-4485-84da-1995257190df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:50.750980 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4ead2305-7407-4b82-bebf-c533fe413a3c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144693 Sep 01 17:41:50.752666 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 324/688] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:41:50 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:41:50.889697 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-5e00e57a-4e01-4485-84da-1995257190df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lazy-loading 'services' on Instance uuid 48752724-82dc-4307-98af-ccc606bf5ca0 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:41:50.958624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-92613426-7039-4241-8dbf-8156dbfe5ee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Action: 'create', calling method: .version_select at 0x7f354a6a7ca0>, body: {"keypair": {"name": "tempest-keypair-807795194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOqMOKyeUztcNiu1Cx96/lBis1+iByo5a3yMpxQF119xGgcV8NmhUpRV3qtuIAsGZJ0AcAKI5SEoadT7c6ZhUMn4++XoAdOee+op0mh9LetJu987yLf3PD+qDHoo9SfeQ=="}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:50.995077 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-92613426-7039-4241-8dbf-8156dbfe5ee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Getting quotas for project e11b8d4a14a9460eb4ce9967f86e4757. Resources: {'key_pairs'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:41:51.008587 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-92613426-7039-4241-8dbf-8156dbfe5ee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Getting quotas for user bcc538bc852f404699d91d17023ae620 and project e11b8d4a14a9460eb4ce9967f86e4757. Resources: {'key_pairs'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:41:51.030957 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5e00e57a-4e01-4485-84da-1995257190df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/os-volume_attachments/bc8b29da-ae5b-4b92-ac27-b28723b25434" status: 202 len: 0 microversion: 2.1 time: 0.393761 Sep 01 17:41:51.032297 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 365/689] 10.222.0.100 () {58 vars in 1421 bytes} [Thu Sep 1 17:41:50 2022] DELETE /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/os-volume_attachments/bc8b29da-ae5b-4b92-ac27-b28723b25434 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:41:51.048584 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-92613426-7039-4241-8dbf-8156dbfe5ee2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.094234 Sep 01 17:41:51.049755 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 325/690] 10.222.0.100 () {62 vars in 1205 bytes} [Thu Sep 1 17:41:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 01 17:41:51.051405 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-45120b29-9115-454b-8a97-f898222626c6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:51.055732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-45120b29-9115-454b-8a97-f898222626c6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:51.069226 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-45120b29-9115-454b-8a97-f898222626c6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:51.069785 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-45120b29-9115-454b-8a97-f898222626c6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:51.070159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-45120b29-9115-454b-8a97-f898222626c6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:51.070880 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-45120b29-9115-454b-8a97-f898222626c6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:51.071657 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-45120b29-9115-454b-8a97-f898222626c6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:51.071940 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-45120b29-9115-454b-8a97-f898222626c6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:51.125651 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-45120b29-9115-454b-8a97-f898222626c6 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087384 Sep 01 17:41:51.126377 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 366/691] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:41:51 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:41:51.764642 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-94bfdaa1-f148-4244-a837-207bd48df5fe tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:51.766852 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-94bfdaa1-f148-4244-a837-207bd48df5fe tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:51.774206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-94bfdaa1-f148-4244-a837-207bd48df5fe tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:51.774689 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-94bfdaa1-f148-4244-a837-207bd48df5fe tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:51.775122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-94bfdaa1-f148-4244-a837-207bd48df5fe tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:51.775820 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-94bfdaa1-f148-4244-a837-207bd48df5fe tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:51.776309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-94bfdaa1-f148-4244-a837-207bd48df5fe tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:51.776731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-94bfdaa1-f148-4244-a837-207bd48df5fe tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:51.809728 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-94bfdaa1-f148-4244-a837-207bd48df5fe tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049047 Sep 01 17:41:51.810437 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 326/692] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:41:51 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:41:52.139626 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d78bd41f-2366-4280-8e36-0cd3d1b601c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:52.142094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d78bd41f-2366-4280-8e36-0cd3d1b601c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:52.150454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d78bd41f-2366-4280-8e36-0cd3d1b601c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:52.150955 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d78bd41f-2366-4280-8e36-0cd3d1b601c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:52.151426 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d78bd41f-2366-4280-8e36-0cd3d1b601c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:52.152144 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d78bd41f-2366-4280-8e36-0cd3d1b601c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:52.152602 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d78bd41f-2366-4280-8e36-0cd3d1b601c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:52.153026 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d78bd41f-2366-4280-8e36-0cd3d1b601c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:52.155881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:52.189451 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d78bd41f-2366-4280-8e36-0cd3d1b601c2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054231 Sep 01 17:41:52.190073 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 367/693] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:41:52 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:41:52.367010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-848165180", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c432092d-3c48-4974-8235-c648e44e8e44"}], "security_groups": [{"name": "tempest-securitygroup--1441405501"}], "key_name": "tempest-keypair-807795194", "user_data": "}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:52.489459 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.network.neutron [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] validate_networks() for [('c432092d-3c48-4974-8235-c648e44e8e44', None, None, None, None, None)] {{(pid=127232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:41:52.616820 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 17:41:52.617050 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Thu Sep 1 17:41:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.100) !!! Sep 01 17:41:52.823818 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cca4c436-f6cc-4e08-b67b-2613a5fc8f04 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:52.826214 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cca4c436-f6cc-4e08-b67b-2613a5fc8f04 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:52.832196 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cca4c436-f6cc-4e08-b67b-2613a5fc8f04 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:52.832686 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cca4c436-f6cc-4e08-b67b-2613a5fc8f04 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:52.833125 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cca4c436-f6cc-4e08-b67b-2613a5fc8f04 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:52.833887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cca4c436-f6cc-4e08-b67b-2613a5fc8f04 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:52.834338 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cca4c436-f6cc-4e08-b67b-2613a5fc8f04 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:52.834954 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cca4c436-f6cc-4e08-b67b-2613a5fc8f04 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:52.868125 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cca4c436-f6cc-4e08-b67b-2613a5fc8f04 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048284 Sep 01 17:41:52.868712 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 368/694] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:41:52 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:41:52.953725 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3abc8772-fa3b-4c16-b669-4b36af6f7d9e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:52.954092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3abc8772-fa3b-4c16-b669-4b36af6f7d9e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:52.960193 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Flavor limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:41:52.960558 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3abc8772-fa3b-4c16-b669-4b36af6f7d9e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:52.960868 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Image limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:41:52.961234 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3abc8772-fa3b-4c16-b669-4b36af6f7d9e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:52.961534 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Flavor pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:41:52.961705 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3abc8772-fa3b-4c16-b669-4b36af6f7d9e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:52.962015 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Image pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:41:52.962408 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3abc8772-fa3b-4c16-b669-4b36af6f7d9e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:52.962509 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:41:52.962930 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3abc8772-fa3b-4c16-b669-4b36af6f7d9e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:52.963274 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3abc8772-fa3b-4c16-b669-4b36af6f7d9e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:52.977255 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:52.977898 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:52.978290 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:52.979019 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:52.979502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:52.980088 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:52.991797 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3abc8772-fa3b-4c16-b669-4b36af6f7d9e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Going to try to terminate instance {{(pid=127233) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:41:53.000187 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Getting quotas for project e11b8d4a14a9460eb4ce9967f86e4757. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:41:53.004514 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Getting quotas for user bcc538bc852f404699d91d17023ae620 and project e11b8d4a14a9460eb4ce9967f86e4757. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:41:53.016936 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Going to run 1 instances... {{(pid=127232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:41:53.019463 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:41:53.078637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3abc8772-fa3b-4c16-b669-4b36af6f7d9e tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "DELETE /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 204 len: 0 microversion: 2.1 time: 0.128895 Sep 01 17:41:53.079826 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 369/695] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:41:52 2022] DELETE /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 17:41:53.085905 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ed0dff1d-c70d-43e2-acbb-391123f63799 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.723007 Sep 01 17:41:53.086547 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 327/696] 10.222.0.100 () {62 vars in 1193 bytes} [Thu Sep 1 17:41:52 2022] POST /compute/v2.1/servers => generated 404 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 01 17:41:53.099672 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8e40c13a-e29d-4525-9902-490400b0508c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:53.100430 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8e40c13a-e29d-4525-9902-490400b0508c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:53.107723 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8e40c13a-e29d-4525-9902-490400b0508c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:53.108221 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8e40c13a-e29d-4525-9902-490400b0508c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:53.108658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8e40c13a-e29d-4525-9902-490400b0508c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:53.109377 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8e40c13a-e29d-4525-9902-490400b0508c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:53.109868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8e40c13a-e29d-4525-9902-490400b0508c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:53.110302 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8e40c13a-e29d-4525-9902-490400b0508c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:53.115448 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-806235e1-dcfb-414c-9737-ef713ca38a88 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:53.116176 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-806235e1-dcfb-414c-9737-ef713ca38a88 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:53.192332 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-806235e1-dcfb-414c-9737-ef713ca38a88 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:53.201730 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-806235e1-dcfb-414c-9737-ef713ca38a88 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:53.203233 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-806235e1-dcfb-414c-9737-ef713ca38a88 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:53.204482 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-806235e1-dcfb-414c-9737-ef713ca38a88 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1284 microversion: 2.20 time: 0.093744 Sep 01 17:41:53.205212 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 328/697] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:53 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:53.210655 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4a5d783f-a920-4cbe-85d4-50fa5cd8f707 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:53.213021 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4a5d783f-a920-4cbe-85d4-50fa5cd8f707 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:53.219989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a5d783f-a920-4cbe-85d4-50fa5cd8f707 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:53.220478 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a5d783f-a920-4cbe-85d4-50fa5cd8f707 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:53.220916 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a5d783f-a920-4cbe-85d4-50fa5cd8f707 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:53.221627 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a5d783f-a920-4cbe-85d4-50fa5cd8f707 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:53.222177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a5d783f-a920-4cbe-85d4-50fa5cd8f707 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:53.222494 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a5d783f-a920-4cbe-85d4-50fa5cd8f707 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:53.259116 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4a5d783f-a920-4cbe-85d4-50fa5cd8f707 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052532 Sep 01 17:41:53.259706 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 329/698] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:41:53 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:41:53.298875 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8e40c13a-e29d-4525-9902-490400b0508c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:53.308144 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8e40c13a-e29d-4525-9902-490400b0508c tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1696 microversion: 2.1 time: 0.222884 Sep 01 17:41:53.308728 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 370/699] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:53 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1696 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:41:53.339568 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-159d65ee-88f7-4cea-9c69-9212bed81063 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:53.340184 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-159d65ee-88f7-4cea-9c69-9212bed81063 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:53.347208 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-159d65ee-88f7-4cea-9c69-9212bed81063 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:53.347654 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-159d65ee-88f7-4cea-9c69-9212bed81063 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:53.348137 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-159d65ee-88f7-4cea-9c69-9212bed81063 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:53.348854 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-159d65ee-88f7-4cea-9c69-9212bed81063 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:53.350069 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-159d65ee-88f7-4cea-9c69-9212bed81063 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:53.350499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-159d65ee-88f7-4cea-9c69-9212bed81063 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:53.379081 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-159d65ee-88f7-4cea-9c69-9212bed81063 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Going to try to terminate instance {{(pid=127232) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:41:53.455144 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-159d65ee-88f7-4cea-9c69-9212bed81063 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 204 len: 0 microversion: 2.1 time: 0.119040 Sep 01 17:41:53.455640 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 330/700] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:41:53 2022] DELETE /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:41:53.464562 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-fbfae3e6-26a8-4d38-8fa7-8ac5663540dd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:53.465171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-fbfae3e6-26a8-4d38-8fa7-8ac5663540dd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:53.471111 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fbfae3e6-26a8-4d38-8fa7-8ac5663540dd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:53.471606 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fbfae3e6-26a8-4d38-8fa7-8ac5663540dd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:53.472017 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fbfae3e6-26a8-4d38-8fa7-8ac5663540dd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:53.472697 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fbfae3e6-26a8-4d38-8fa7-8ac5663540dd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:53.473142 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fbfae3e6-26a8-4d38-8fa7-8ac5663540dd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:53.473556 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fbfae3e6-26a8-4d38-8fa7-8ac5663540dd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:53.728822 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-fbfae3e6-26a8-4d38-8fa7-8ac5663540dd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:53.740902 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-fbfae3e6-26a8-4d38-8fa7-8ac5663540dd tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1686 microversion: 2.1 time: 0.279770 Sep 01 17:41:53.753848 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 371/701] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:53 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1686 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:54.229603 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a877aaa5-7c91-44e9-954f-b0f2aff1bf4a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:54.230418 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a877aaa5-7c91-44e9-954f-b0f2aff1bf4a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:54.237022 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a877aaa5-7c91-44e9-954f-b0f2aff1bf4a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:54.237770 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a877aaa5-7c91-44e9-954f-b0f2aff1bf4a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:54.238245 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a877aaa5-7c91-44e9-954f-b0f2aff1bf4a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:54.239069 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a877aaa5-7c91-44e9-954f-b0f2aff1bf4a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:54.240205 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a877aaa5-7c91-44e9-954f-b0f2aff1bf4a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:54.241032 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a877aaa5-7c91-44e9-954f-b0f2aff1bf4a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:54.262906 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:54.330318 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a877aaa5-7c91-44e9-954f-b0f2aff1bf4a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:54.335522 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1073f6fe-e1fd-4d0d-9549-d99258871bcd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:54.336791 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-1073f6fe-e1fd-4d0d-9549-d99258871bcd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:54.340232 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a877aaa5-7c91-44e9-954f-b0f2aff1bf4a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:54.341884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a877aaa5-7c91-44e9-954f-b0f2aff1bf4a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:54.343287 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a877aaa5-7c91-44e9-954f-b0f2aff1bf4a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1288 microversion: 2.20 time: 0.119576 Sep 01 17:41:54.344007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 331/702] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:54 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1288 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:54.357831 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1073f6fe-e1fd-4d0d-9549-d99258871bcd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:54.357831 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1073f6fe-e1fd-4d0d-9549-d99258871bcd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:54.357831 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1073f6fe-e1fd-4d0d-9549-d99258871bcd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:54.357831 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1073f6fe-e1fd-4d0d-9549-d99258871bcd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:54.358554 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1073f6fe-e1fd-4d0d-9549-d99258871bcd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:54.358554 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1073f6fe-e1fd-4d0d-9549-d99258871bcd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:54.526909 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-1073f6fe-e1fd-4d0d-9549-d99258871bcd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:54.536260 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1073f6fe-e1fd-4d0d-9549-d99258871bcd tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1696 microversion: 2.1 time: 0.205448 Sep 01 17:41:54.537454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 372/703] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:54 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1696 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:54.762367 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d0f2e542-f1cc-427e-b4b3-5e2c3c2cf49f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:54.762986 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d0f2e542-f1cc-427e-b4b3-5e2c3c2cf49f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:54.769436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d0f2e542-f1cc-427e-b4b3-5e2c3c2cf49f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:54.769960 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d0f2e542-f1cc-427e-b4b3-5e2c3c2cf49f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:54.770399 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d0f2e542-f1cc-427e-b4b3-5e2c3c2cf49f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:54.771982 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d0f2e542-f1cc-427e-b4b3-5e2c3c2cf49f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:54.772444 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d0f2e542-f1cc-427e-b4b3-5e2c3c2cf49f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:54.772870 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d0f2e542-f1cc-427e-b4b3-5e2c3c2cf49f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:54.932540 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d0f2e542-f1cc-427e-b4b3-5e2c3c2cf49f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:54.941393 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d0f2e542-f1cc-427e-b4b3-5e2c3c2cf49f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1686 microversion: 2.1 time: 0.183165 Sep 01 17:41:54.942314 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 332/704] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:54 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:55.368220 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-65950b14-2b2c-477f-ae9e-3bf1c1726ee4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:55.368806 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-65950b14-2b2c-477f-ae9e-3bf1c1726ee4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:55.375288 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-65950b14-2b2c-477f-ae9e-3bf1c1726ee4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:55.375764 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-65950b14-2b2c-477f-ae9e-3bf1c1726ee4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:55.376191 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-65950b14-2b2c-477f-ae9e-3bf1c1726ee4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:55.376877 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-65950b14-2b2c-477f-ae9e-3bf1c1726ee4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:55.377321 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-65950b14-2b2c-477f-ae9e-3bf1c1726ee4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:55.377766 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-65950b14-2b2c-477f-ae9e-3bf1c1726ee4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:55.441749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-65950b14-2b2c-477f-ae9e-3bf1c1726ee4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:55.451223 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-65950b14-2b2c-477f-ae9e-3bf1c1726ee4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:55.452657 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-65950b14-2b2c-477f-ae9e-3bf1c1726ee4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:55.453780 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-65950b14-2b2c-477f-ae9e-3bf1c1726ee4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1288 microversion: 2.20 time: 0.090117 Sep 01 17:41:55.454335 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 373/705] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:55 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:55.558415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8f8b6842-e858-4c89-af7b-d563190788f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:55.559025 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8f8b6842-e858-4c89-af7b-d563190788f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:55.565190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8f8b6842-e858-4c89-af7b-d563190788f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:55.565719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8f8b6842-e858-4c89-af7b-d563190788f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:55.566156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8f8b6842-e858-4c89-af7b-d563190788f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:55.566852 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8f8b6842-e858-4c89-af7b-d563190788f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:55.567306 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8f8b6842-e858-4c89-af7b-d563190788f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:55.568361 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8f8b6842-e858-4c89-af7b-d563190788f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:55.700626 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8f8b6842-e858-4c89-af7b-d563190788f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:55.708493 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8f8b6842-e858-4c89-af7b-d563190788f8 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1696 microversion: 2.1 time: 0.153800 Sep 01 17:41:55.709060 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 333/706] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:55 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:55.963328 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ab716560-2c31-4972-854f-39c71f46adbe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:55.963812 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ab716560-2c31-4972-854f-39c71f46adbe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:55.969772 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ab716560-2c31-4972-854f-39c71f46adbe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:55.970256 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ab716560-2c31-4972-854f-39c71f46adbe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:55.970690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ab716560-2c31-4972-854f-39c71f46adbe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:55.971375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ab716560-2c31-4972-854f-39c71f46adbe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:55.971833 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ab716560-2c31-4972-854f-39c71f46adbe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:55.972251 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ab716560-2c31-4972-854f-39c71f46adbe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:56.109757 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ab716560-2c31-4972-854f-39c71f46adbe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:56.118982 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ab716560-2c31-4972-854f-39c71f46adbe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1686 microversion: 2.1 time: 0.159589 Sep 01 17:41:56.119569 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 374/707] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:55 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:56.477081 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ff26b7a3-1a9a-43fc-9027-66839eb7ebf1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:56.477661 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ff26b7a3-1a9a-43fc-9027-66839eb7ebf1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:56.484283 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ff26b7a3-1a9a-43fc-9027-66839eb7ebf1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:56.484769 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ff26b7a3-1a9a-43fc-9027-66839eb7ebf1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:56.485211 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ff26b7a3-1a9a-43fc-9027-66839eb7ebf1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:56.485999 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ff26b7a3-1a9a-43fc-9027-66839eb7ebf1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:56.486404 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ff26b7a3-1a9a-43fc-9027-66839eb7ebf1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:56.486826 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ff26b7a3-1a9a-43fc-9027-66839eb7ebf1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:56.551551 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ff26b7a3-1a9a-43fc-9027-66839eb7ebf1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:56.559869 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ff26b7a3-1a9a-43fc-9027-66839eb7ebf1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:56.561307 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ff26b7a3-1a9a-43fc-9027-66839eb7ebf1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:56.562478 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ff26b7a3-1a9a-43fc-9027-66839eb7ebf1 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1288 microversion: 2.20 time: 0.090034 Sep 01 17:41:56.563035 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 334/708] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:56 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:56.729957 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6db1bc1e-e526-425b-900d-f4da54f6c1ef tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:56.730656 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6db1bc1e-e526-425b-900d-f4da54f6c1ef tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:56.736902 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6db1bc1e-e526-425b-900d-f4da54f6c1ef tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:56.737382 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6db1bc1e-e526-425b-900d-f4da54f6c1ef tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:56.737854 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6db1bc1e-e526-425b-900d-f4da54f6c1ef tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:56.738550 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6db1bc1e-e526-425b-900d-f4da54f6c1ef tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:56.739006 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6db1bc1e-e526-425b-900d-f4da54f6c1ef tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:56.739428 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6db1bc1e-e526-425b-900d-f4da54f6c1ef tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:56.867785 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-6db1bc1e-e526-425b-900d-f4da54f6c1ef tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:56.875429 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-6db1bc1e-e526-425b-900d-f4da54f6c1ef tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1696 microversion: 2.1 time: 0.149566 Sep 01 17:41:56.876002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 375/709] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:56 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1696 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:57.140488 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-1966132f-bec0-402d-b59f-8b294e0b9ab4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:57.141126 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-1966132f-bec0-402d-b59f-8b294e0b9ab4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:57.147749 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1966132f-bec0-402d-b59f-8b294e0b9ab4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:57.148229 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1966132f-bec0-402d-b59f-8b294e0b9ab4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:57.148662 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1966132f-bec0-402d-b59f-8b294e0b9ab4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:57.149341 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1966132f-bec0-402d-b59f-8b294e0b9ab4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:57.149815 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1966132f-bec0-402d-b59f-8b294e0b9ab4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:57.150228 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1966132f-bec0-402d-b59f-8b294e0b9ab4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:57.292894 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1966132f-bec0-402d-b59f-8b294e0b9ab4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:57.300923 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-1966132f-bec0-402d-b59f-8b294e0b9ab4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1686 microversion: 2.1 time: 0.164227 Sep 01 17:41:57.301492 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 335/710] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:57 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:57.586291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b07f6f55-094c-4477-b709-6478338107c2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:57.586805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-b07f6f55-094c-4477-b709-6478338107c2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:57.592684 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b07f6f55-094c-4477-b709-6478338107c2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:57.593159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b07f6f55-094c-4477-b709-6478338107c2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:57.593595 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b07f6f55-094c-4477-b709-6478338107c2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:57.594286 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b07f6f55-094c-4477-b709-6478338107c2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:57.594733 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b07f6f55-094c-4477-b709-6478338107c2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:57.595149 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b07f6f55-094c-4477-b709-6478338107c2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:57.655351 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b07f6f55-094c-4477-b709-6478338107c2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:57.664926 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b07f6f55-094c-4477-b709-6478338107c2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:57.666390 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b07f6f55-094c-4477-b709-6478338107c2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:57.667526 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-b07f6f55-094c-4477-b709-6478338107c2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1288 microversion: 2.20 time: 0.085457 Sep 01 17:41:57.668074 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 376/711] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:57 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:57.897408 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-eea97aae-0fd0-4c0b-89c9-9d4e58345989 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:57.898051 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-eea97aae-0fd0-4c0b-89c9-9d4e58345989 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:57.904419 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eea97aae-0fd0-4c0b-89c9-9d4e58345989 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:57.904903 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eea97aae-0fd0-4c0b-89c9-9d4e58345989 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:57.905340 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eea97aae-0fd0-4c0b-89c9-9d4e58345989 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:57.906073 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eea97aae-0fd0-4c0b-89c9-9d4e58345989 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:57.906532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eea97aae-0fd0-4c0b-89c9-9d4e58345989 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:57.906968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eea97aae-0fd0-4c0b-89c9-9d4e58345989 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:58.045290 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-eea97aae-0fd0-4c0b-89c9-9d4e58345989 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:58.053460 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-eea97aae-0fd0-4c0b-89c9-9d4e58345989 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1696 microversion: 2.1 time: 0.160538 Sep 01 17:41:58.054125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 336/712] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:57 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:58.323430 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5f0bec61-5665-4f57-a25e-3214ad52fddf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:58.324040 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5f0bec61-5665-4f57-a25e-3214ad52fddf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:58.331165 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f0bec61-5665-4f57-a25e-3214ad52fddf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:58.331824 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f0bec61-5665-4f57-a25e-3214ad52fddf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:58.332205 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f0bec61-5665-4f57-a25e-3214ad52fddf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:58.332978 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f0bec61-5665-4f57-a25e-3214ad52fddf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:58.334079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f0bec61-5665-4f57-a25e-3214ad52fddf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:58.334646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f0bec61-5665-4f57-a25e-3214ad52fddf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:58.693392 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9e2a61d6-3edb-4ca4-9bb1-058badcb2dbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:58.694734 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9e2a61d6-3edb-4ca4-9bb1-058badcb2dbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:58.696678 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:58.702691 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9e2a61d6-3edb-4ca4-9bb1-058badcb2dbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:58.703348 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9e2a61d6-3edb-4ca4-9bb1-058badcb2dbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:58.703942 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9e2a61d6-3edb-4ca4-9bb1-058badcb2dbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:58.704844 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9e2a61d6-3edb-4ca4-9bb1-058badcb2dbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:58.705301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9e2a61d6-3edb-4ca4-9bb1-058badcb2dbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:58.705953 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9e2a61d6-3edb-4ca4-9bb1-058badcb2dbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:58.706714 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5f0bec61-5665-4f57-a25e-3214ad52fddf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:58.716582 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5f0bec61-5665-4f57-a25e-3214ad52fddf tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1686 microversion: 2.1 time: 0.397104 Sep 01 17:41:58.717713 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 377/713] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:58 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1686 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:59.074570 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f838c783-5e66-4abb-9ac6-b085f7fd4860 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:59.075203 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f838c783-5e66-4abb-9ac6-b085f7fd4860 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:59.087334 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f838c783-5e66-4abb-9ac6-b085f7fd4860 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:59.088701 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f838c783-5e66-4abb-9ac6-b085f7fd4860 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:59.089613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f838c783-5e66-4abb-9ac6-b085f7fd4860 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:59.090717 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f838c783-5e66-4abb-9ac6-b085f7fd4860 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:59.091543 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f838c783-5e66-4abb-9ac6-b085f7fd4860 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:59.092022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f838c783-5e66-4abb-9ac6-b085f7fd4860 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:59.102399 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9e2a61d6-3edb-4ca4-9bb1-058badcb2dbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:59.127945 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9e2a61d6-3edb-4ca4-9bb1-058badcb2dbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:59.129382 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9e2a61d6-3edb-4ca4-9bb1-058badcb2dbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:59.130672 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9e2a61d6-3edb-4ca4-9bb1-058badcb2dbb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1336 microversion: 2.20 time: 0.443902 Sep 01 17:41:59.145644 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 337/714] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:58 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1336 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:41:59.432221 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f838c783-5e66-4abb-9ac6-b085f7fd4860 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:59.440208 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f838c783-5e66-4abb-9ac6-b085f7fd4860 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1696 microversion: 2.1 time: 0.369688 Sep 01 17:41:59.441032 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 378/715] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:59 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1696 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:41:59.742057 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6f6ad850-c2f3-4085-b479-f309de625a3b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:59.742889 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6f6ad850-c2f3-4085-b479-f309de625a3b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:59.753000 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6f6ad850-c2f3-4085-b479-f309de625a3b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:59.753503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6f6ad850-c2f3-4085-b479-f309de625a3b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:59.754993 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6f6ad850-c2f3-4085-b479-f309de625a3b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:59.754993 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6f6ad850-c2f3-4085-b479-f309de625a3b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:59.756424 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6f6ad850-c2f3-4085-b479-f309de625a3b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:59.756424 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6f6ad850-c2f3-4085-b479-f309de625a3b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:59.877207 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6f6ad850-c2f3-4085-b479-f309de625a3b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:59.887743 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6f6ad850-c2f3-4085-b479-f309de625a3b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1618 microversion: 2.1 time: 0.152949 Sep 01 17:41:59.889513 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 338/716] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:59 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1618 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:00.164800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5f6949aa-5b56-4ea4-b0a5-c1382f8f04e4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:00.169319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5f6949aa-5b56-4ea4-b0a5-c1382f8f04e4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:00.202562 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f6949aa-5b56-4ea4-b0a5-c1382f8f04e4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:00.205247 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f6949aa-5b56-4ea4-b0a5-c1382f8f04e4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:00.207560 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f6949aa-5b56-4ea4-b0a5-c1382f8f04e4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:00.210994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f6949aa-5b56-4ea4-b0a5-c1382f8f04e4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:00.211685 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f6949aa-5b56-4ea4-b0a5-c1382f8f04e4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:00.212320 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f6949aa-5b56-4ea4-b0a5-c1382f8f04e4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:00.621856 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5f6949aa-5b56-4ea4-b0a5-c1382f8f04e4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:00.640568 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5f6949aa-5b56-4ea4-b0a5-c1382f8f04e4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:00.644049 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5f6949aa-5b56-4ea4-b0a5-c1382f8f04e4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:00.647513 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5f6949aa-5b56-4ea4-b0a5-c1382f8f04e4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1410 microversion: 2.20 time: 0.494019 Sep 01 17:42:00.662998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 379/717] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:00 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1410 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:00.678019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:00.679025 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:00.696195 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-0b7129da-dca5-44f2-ad9e-b0380a07df3d req-9c82a0c7-6b8f-4478-b9f0-b337e7e7cc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd635ada-9195-43da-a0a3-b131c9132dd6", "name": "network-vif-deleted", "tag": "9345839b-552d-4f2c-8201-39a0d79147af"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:00.713515 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:00.717698 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:00.718822 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:00.721311 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-0b7129da-dca5-44f2-ad9e-b0380a07df3d req-9c82a0c7-6b8f-4478-b9f0-b337e7e7cc2d service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:00.722427 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-0b7129da-dca5-44f2-ad9e-b0380a07df3d req-9c82a0c7-6b8f-4478-b9f0-b337e7e7cc2d service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:00.722986 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:00.724132 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:00.724256 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-0b7129da-dca5-44f2-ad9e-b0380a07df3d req-9c82a0c7-6b8f-4478-b9f0-b337e7e7cc2d service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:00.725349 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:00.754026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-0b7129da-dca5-44f2-ad9e-b0380a07df3d req-9c82a0c7-6b8f-4478-b9f0-b337e7e7cc2d service nova] Creating event network-vif-deleted:9345839b-552d-4f2c-8201-39a0d79147af for instance fd635ada-9195-43da-a0a3-b131c9132dd6 on hv-cinder-83976 Sep 01 17:42:00.769872 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-0b7129da-dca5-44f2-ad9e-b0380a07df3d req-9c82a0c7-6b8f-4478-b9f0-b337e7e7cc2d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.487560 Sep 01 17:42:00.774333 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 339/718] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:42:00.796636 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:00.798546 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:00.801179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:00.802875 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lazy-loading 'fault' on Instance uuid fd635ada-9195-43da-a0a3-b131c9132dd6 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:42:00.867208 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:00.876316 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4cb8dc00-7cde-4d22-8359-b11455c34bca tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 200 len: 1340 microversion: 2.1 time: 0.211893 Sep 01 17:42:00.879097 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 380/719] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:00 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 1340 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:00.913883 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:00.918007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:00.926626 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:00.927492 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:00.928128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:00.929030 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:00.929866 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:00.930474 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:01.015384 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:01.015678 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:01.016127 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:01.016951 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lazy-loading 'fault' on Instance uuid 48752724-82dc-4307-98af-ccc606bf5ca0 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:42:01.096446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:01.105939 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-06d917f5-9b20-41f9-9cf5-d8e6fac99702 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 200 len: 1335 microversion: 2.1 time: 0.196995 Sep 01 17:42:01.107182 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 340/720] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:00 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 1335 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:01.244027 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-efb1c49e-eeee-4269-927d-944e0c909944 req-2e5cf68c-e072-4316-824c-e87be2169fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3623a32e-47b4-43dc-a80b-ca4254f4eaa5", "tag": "67cfe8a5-3543-438d-a85f-436e1ad2ec3b"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:01.254087 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-efb1c49e-eeee-4269-927d-944e0c909944 req-2e5cf68c-e072-4316-824c-e87be2169fd2 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:01.254576 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-efb1c49e-eeee-4269-927d-944e0c909944 req-2e5cf68c-e072-4316-824c-e87be2169fd2 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:01.255601 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-efb1c49e-eeee-4269-927d-944e0c909944 req-2e5cf68c-e072-4316-824c-e87be2169fd2 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:01.268716 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-efb1c49e-eeee-4269-927d-944e0c909944 req-2e5cf68c-e072-4316-824c-e87be2169fd2 service nova] Creating event network-changed:67cfe8a5-3543-438d-a85f-436e1ad2ec3b for instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 on hv-cinder-83976 Sep 01 17:42:01.274696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-efb1c49e-eeee-4269-927d-944e0c909944 req-2e5cf68c-e072-4316-824c-e87be2169fd2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133808 Sep 01 17:42:01.275309 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 381/721] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:01.679539 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b105b77b-9179-4d65-8f4c-7078319f158e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:01.680155 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b105b77b-9179-4d65-8f4c-7078319f158e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:01.692748 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b105b77b-9179-4d65-8f4c-7078319f158e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:01.693251 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b105b77b-9179-4d65-8f4c-7078319f158e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:01.695561 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b105b77b-9179-4d65-8f4c-7078319f158e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:01.699902 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b105b77b-9179-4d65-8f4c-7078319f158e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:01.700845 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b105b77b-9179-4d65-8f4c-7078319f158e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:01.700996 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b105b77b-9179-4d65-8f4c-7078319f158e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:01.902592 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-55cd7db4-c900-470f-b6ee-523b9f5da59f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:01.904244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-55cd7db4-c900-470f-b6ee-523b9f5da59f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: fd635ada-9195-43da-a0a3-b131c9132dd6] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:01.920913 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-55cd7db4-c900-470f-b6ee-523b9f5da59f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:01.921880 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-55cd7db4-c900-470f-b6ee-523b9f5da59f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:01.922948 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-55cd7db4-c900-470f-b6ee-523b9f5da59f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:01.926592 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b105b77b-9179-4d65-8f4c-7078319f158e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:01.928354 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-55cd7db4-c900-470f-b6ee-523b9f5da59f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:01.928961 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-55cd7db4-c900-470f-b6ee-523b9f5da59f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:01.929475 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-55cd7db4-c900-470f-b6ee-523b9f5da59f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:01.941620 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b105b77b-9179-4d65-8f4c-7078319f158e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:01.944231 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b105b77b-9179-4d65-8f4c-7078319f158e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:01.945668 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b105b77b-9179-4d65-8f4c-7078319f158e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1410 microversion: 2.20 time: 0.270913 Sep 01 17:42:01.954000 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 341/722] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:01 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1410 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:01.965056 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-55cd7db4-c900-470f-b6ee-523b9f5da59f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] HTTP exception thrown: Instance fd635ada-9195-43da-a0a3-b131c9132dd6 could not be found. Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-55cd7db4-c900-470f-b6ee-523b9f5da59f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Request method failure captured: Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 HTTP/1.1 Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2m8zyf1MdfI9Plug8mrFjRApjQ5c-8jQisg1PVk0tj5vFsUELO_1M1udUcyP_UxAfWvOWoJ8fDtqa8LTzrnjXG6uPV0irrnSvS-1H3XCvA0zw3nvSo7ARUEiib2-x1XXV_v7wdYFSh1m3JfZWwThjo3uq-lxNxGev-IFpfAVdzDqI Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: b01df46ff9744c2f830459547d7e4dd6 Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:42:01.967155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:42:01.968646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:42:01.968646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:42:01.968646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: b01df46ff9744c2f830459547d7e4dd6 Sep 01 17:42:01.968646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:42:01.968646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-ServerRescueNegativeTestJSON-1908064911-project Sep 01 17:42:01.968646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:42:01.968646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:42:01.968646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: 5647214c5b3f438eb3ef1ddc14153d9e Sep 01 17:42:01.968646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1908064911-project Sep 01 17:42:01.968646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:42:01.968646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance fd635ada-9195-43da-a0a3-b131c9132dd6 could not be found. Sep 01 17:42:01.968646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': 'fd635ada-9195-43da-a0a3-b131c9132dd6'} Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd635ada-9195-43da-a0a3-b131c9132dd6 could not be found. Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:42:01.969393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd635ada-9195-43da-a0a3-b131c9132dd6 could not be found. Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd635ada-9195-43da-a0a3-b131c9132dd6 could not be found. Sep 01 17:42:01.970689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:01.976475 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-55cd7db4-c900-470f-b6ee-523b9f5da59f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Returning 404 to user: Instance fd635ada-9195-43da-a0a3-b131c9132dd6 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:42:01.976475 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-55cd7db4-c900-470f-b6ee-523b9f5da59f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6" status: 404 len: 111 microversion: 2.1 time: 0.073409 Sep 01 17:42:01.976475 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 382/723] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:01 2022] GET /compute/v2.1/servers/fd635ada-9195-43da-a0a3-b131c9132dd6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:42:01.981871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bb17732f-2a83-4f3b-9e5d-ecfb6398be17 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '.version_select at 0x7f354a62fa60>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:02.008045 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bb17732f-2a83-4f3b-9e5d-ecfb6398be17 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563200782" status: 202 len: 0 microversion: 2.1 time: 0.030097 Sep 01 17:42:02.008635 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 342/724] 10.222.0.100 () {58 vars in 1226 bytes} [Thu Sep 1 17:42:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563200782 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:42:02.136074 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b2e3ae69-f136-41df-8389-24bdb7badc7b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:02.136920 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-b2e3ae69-f136-41df-8389-24bdb7badc7b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:02.147087 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b2e3ae69-f136-41df-8389-24bdb7badc7b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:02.147862 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b2e3ae69-f136-41df-8389-24bdb7badc7b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:02.148460 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b2e3ae69-f136-41df-8389-24bdb7badc7b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:02.150428 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b2e3ae69-f136-41df-8389-24bdb7badc7b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:02.151258 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b2e3ae69-f136-41df-8389-24bdb7badc7b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:02.152626 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b2e3ae69-f136-41df-8389-24bdb7badc7b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:02.163727 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:02.182121 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-b2e3ae69-f136-41df-8389-24bdb7badc7b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b2e3ae69-f136-41df-8389-24bdb7badc7b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 HTTP/1.1 Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:42:02.184998 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:42:02.186391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:42:02.186391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:42:02.186391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:42:02.186391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:42:02.186391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:42:02.186391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:42:02.186391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:42:02.186391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:42:02.186391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:42:02.186391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:42:02.186391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:42:02.186391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '48752724-82dc-4307-98af-ccc606bf5ca0'} Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:42:02.187115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:42:02.188801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:02.195016 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b2e3ae69-f136-41df-8389-24bdb7badc7b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 404 to user: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:42:02.195016 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-b2e3ae69-f136-41df-8389-24bdb7badc7b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 404 len: 111 microversion: 2.1 time: 0.056997 Sep 01 17:42:02.195016 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 383/725] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:02 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:42:02.199351 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-74148d8d-b510-46d3-b4c4-2dd1faac4dce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '.version_select at 0x7f354a581040>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:02.234980 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-74148d8d-b510-46d3-b4c4-2dd1faac4dce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553554918" status: 202 len: 0 microversion: 2.1 time: 0.038577 Sep 01 17:42:02.234980 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 343/726] 10.222.0.100 () {58 vars in 1226 bytes} [Thu Sep 1 17:42:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553554918 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:42:02.800231 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-581c72a3-b4a5-4efd-ad50-4e664af429e2 req-94cfc0fc-a514-4ff0-87e0-745fa880dac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48752724-82dc-4307-98af-ccc606bf5ca0", "name": "network-vif-deleted", "tag": "0989218c-f26f-4809-a710-623c2a8f5c2b"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:02.814401 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-581c72a3-b4a5-4efd-ad50-4e664af429e2 req-94cfc0fc-a514-4ff0-87e0-745fa880dac1 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:02.814887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-581c72a3-b4a5-4efd-ad50-4e664af429e2 req-94cfc0fc-a514-4ff0-87e0-745fa880dac1 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:02.816348 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-581c72a3-b4a5-4efd-ad50-4e664af429e2 req-94cfc0fc-a514-4ff0-87e0-745fa880dac1 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:02.840350 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-581c72a3-b4a5-4efd-ad50-4e664af429e2 req-94cfc0fc-a514-4ff0-87e0-745fa880dac1 service nova] Creating event network-vif-deleted:0989218c-f26f-4809-a710-623c2a8f5c2b for instance 48752724-82dc-4307-98af-ccc606bf5ca0 on hv-cinder-83976 Sep 01 17:42:02.846647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-581c72a3-b4a5-4efd-ad50-4e664af429e2 req-94cfc0fc-a514-4ff0-87e0-745fa880dac1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049733 Sep 01 17:42:02.847815 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 384/727] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:02.974875 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-886f98ab-ca27-452d-ac1a-95933be1d218 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:02.976479 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-886f98ab-ca27-452d-ac1a-95933be1d218 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:02.991050 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-886f98ab-ca27-452d-ac1a-95933be1d218 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:02.991965 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-886f98ab-ca27-452d-ac1a-95933be1d218 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:02.993037 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-886f98ab-ca27-452d-ac1a-95933be1d218 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:02.994526 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-886f98ab-ca27-452d-ac1a-95933be1d218 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:02.995499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-886f98ab-ca27-452d-ac1a-95933be1d218 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:02.996162 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-886f98ab-ca27-452d-ac1a-95933be1d218 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:02.997063 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:03.192430 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3ddea5f2-157e-4655-8077-c015feb43642 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Action: 'create', calling method: .version_select at 0x7f354a4765e0>, body: {"keypair": {"name": "tempest-keypair-119185106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLboSgT98EqC1nf8NYPQc9YK93TEEhZNMlxvpHNz3o+oxFjgwNtNX97kjJtg10WlbBiAfqf/sTUlK7DMmPL+qts11wZjXPqYh25hHiZSMf6oYQCdeFTc9edI61KGuYYgw=="}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:03.198565 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=12 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:03.216936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-3ddea5f2-157e-4655-8077-c015feb43642 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for project 1cf7216d5c904b24a9665755720cf287. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:42:03.221510 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-3ddea5f2-157e-4655-8077-c015feb43642 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for user d3848643d2c44951b78814ccf7d504af and project 1cf7216d5c904b24a9665755720cf287. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:42:03.223179 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-886f98ab-ca27-452d-ac1a-95933be1d218 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:03.240301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-886f98ab-ca27-452d-ac1a-95933be1d218 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:03.246171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-886f98ab-ca27-452d-ac1a-95933be1d218 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:03.248166 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-886f98ab-ca27-452d-ac1a-95933be1d218 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1410 microversion: 2.20 time: 0.281841 Sep 01 17:42:03.249229 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 344/728] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:02 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1410 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:03.250992 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3ddea5f2-157e-4655-8077-c015feb43642 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068631 Sep 01 17:42:03.251956 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 385/729] 10.222.0.100 () {60 vars in 1164 bytes} [Thu Sep 1 17:42:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:04.274084 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4402b022-6c8a-4157-8b78-8c11e99952d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:04.274829 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4402b022-6c8a-4157-8b78-8c11e99952d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:04.282627 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4402b022-6c8a-4157-8b78-8c11e99952d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:04.283106 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4402b022-6c8a-4157-8b78-8c11e99952d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:04.283587 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4402b022-6c8a-4157-8b78-8c11e99952d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:04.284227 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4402b022-6c8a-4157-8b78-8c11e99952d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:04.284675 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4402b022-6c8a-4157-8b78-8c11e99952d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:04.285553 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4402b022-6c8a-4157-8b78-8c11e99952d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:04.472612 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4402b022-6c8a-4157-8b78-8c11e99952d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:04.483021 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4402b022-6c8a-4157-8b78-8c11e99952d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:04.485123 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4402b022-6c8a-4157-8b78-8c11e99952d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:04.486393 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4402b022-6c8a-4157-8b78-8c11e99952d4 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1410 microversion: 2.20 time: 0.216986 Sep 01 17:42:04.487075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 345/730] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:04 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1410 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:04.548905 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1223576908", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "633c7f8a-adb2-49f1-988f-caf4bcddf2dc"}], "security_groups": [{"name": "tempest-securitygroup--1464767951"}], "key_name": "tempest-keypair-119185106", "user_data": "}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:04.660256 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.network.neutron [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] validate_networks() for [('633c7f8a-adb2-49f1-988f-caf4bcddf2dc', None, None, None, None, None)] {{(pid=127233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:42:05.104989 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Flavor limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:42:05.105414 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Image limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:42:05.105912 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Flavor pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:42:05.106327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Image pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:42:05.106771 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:42:05.116184 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:05.116664 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:05.117096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:05.117863 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:05.118318 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:05.118738 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:05.136476 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for project 1cf7216d5c904b24a9665755720cf287. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:42:05.140486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for user d3848643d2c44951b78814ccf7d504af and project 1cf7216d5c904b24a9665755720cf287. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:42:05.153082 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Going to run 1 instances... {{(pid=127233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:42:05.155536 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:42:05.205117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-9d9b4da4-e6f8-4adb-8a57-216ada0ba35b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.661051 Sep 01 17:42:05.205895 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 386/731] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:42:04 2022] POST /compute/v2.1/servers => generated 404 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:42:05.217438 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bdd2d487-1ddb-41e7-93d6-44d5a73a2b93 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:05.218086 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bdd2d487-1ddb-41e7-93d6-44d5a73a2b93 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:05.272902 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bdd2d487-1ddb-41e7-93d6-44d5a73a2b93 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:05.280466 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bdd2d487-1ddb-41e7-93d6-44d5a73a2b93 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1245 microversion: 2.1 time: 0.066853 Sep 01 17:42:05.285896 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 346/732] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:05 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1245 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:05.512574 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-85377f5a-122c-46cc-b29d-507b45c96a46 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:05.513393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-85377f5a-122c-46cc-b29d-507b45c96a46 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:05.519435 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f197f3a8-b898-4621-aa10-bf633e7df07f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:05.520259 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f197f3a8-b898-4621-aa10-bf633e7df07f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:05.525927 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-85377f5a-122c-46cc-b29d-507b45c96a46 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:05.526709 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f197f3a8-b898-4621-aa10-bf633e7df07f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:05.526874 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-85377f5a-122c-46cc-b29d-507b45c96a46 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:05.527171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-85377f5a-122c-46cc-b29d-507b45c96a46 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:05.527673 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f197f3a8-b898-4621-aa10-bf633e7df07f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:05.527873 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-85377f5a-122c-46cc-b29d-507b45c96a46 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:05.528324 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-85377f5a-122c-46cc-b29d-507b45c96a46 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:05.528749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-85377f5a-122c-46cc-b29d-507b45c96a46 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:05.528926 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f197f3a8-b898-4621-aa10-bf633e7df07f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:05.529855 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f197f3a8-b898-4621-aa10-bf633e7df07f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:05.530297 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f197f3a8-b898-4621-aa10-bf633e7df07f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:05.530873 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f197f3a8-b898-4621-aa10-bf633e7df07f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:05.558402 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f197f3a8-b898-4621-aa10-bf633e7df07f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Going to try to terminate instance {{(pid=127232) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:42:05.668535 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f197f3a8-b898-4621-aa10-bf633e7df07f tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "DELETE /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 204 len: 0 microversion: 2.1 time: 0.152819 Sep 01 17:42:05.669250 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 347/733] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:42:05 2022] DELETE /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:42:05.678612 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-597df23c-9efa-470f-a724-ff8e2ecc9288 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:05.679580 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-597df23c-9efa-470f-a724-ff8e2ecc9288 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:05.686046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-597df23c-9efa-470f-a724-ff8e2ecc9288 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:05.686531 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-597df23c-9efa-470f-a724-ff8e2ecc9288 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:05.687029 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-597df23c-9efa-470f-a724-ff8e2ecc9288 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:05.687738 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-597df23c-9efa-470f-a724-ff8e2ecc9288 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:05.688226 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-597df23c-9efa-470f-a724-ff8e2ecc9288 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:05.688648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-597df23c-9efa-470f-a724-ff8e2ecc9288 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:05.752195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-85377f5a-122c-46cc-b29d-507b45c96a46 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:05.766043 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-85377f5a-122c-46cc-b29d-507b45c96a46 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:05.767856 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-85377f5a-122c-46cc-b29d-507b45c96a46 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:05.768966 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-85377f5a-122c-46cc-b29d-507b45c96a46 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1410 microversion: 2.20 time: 0.260909 Sep 01 17:42:05.769447 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 387/734] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:05 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1410 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:05.852608 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-597df23c-9efa-470f-a724-ff8e2ecc9288 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:05.861087 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-597df23c-9efa-470f-a724-ff8e2ecc9288 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1512 microversion: 2.1 time: 0.187363 Sep 01 17:42:05.861681 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 348/735] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:05 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:06.303049 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8e8624a1-a954-4e12-bc5c-f82c8c9b4eef tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:06.303661 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8e8624a1-a954-4e12-bc5c-f82c8c9b4eef tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:06.309869 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8e8624a1-a954-4e12-bc5c-f82c8c9b4eef tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.310364 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8e8624a1-a954-4e12-bc5c-f82c8c9b4eef tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.311141 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8e8624a1-a954-4e12-bc5c-f82c8c9b4eef tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.311514 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8e8624a1-a954-4e12-bc5c-f82c8c9b4eef tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.311965 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8e8624a1-a954-4e12-bc5c-f82c8c9b4eef tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.312385 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8e8624a1-a954-4e12-bc5c-f82c8c9b4eef tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.380338 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8e8624a1-a954-4e12-bc5c-f82c8c9b4eef tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:06.388340 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8e8624a1-a954-4e12-bc5c-f82c8c9b4eef tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1241 microversion: 2.1 time: 0.089307 Sep 01 17:42:06.388937 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 388/736] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:06 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:06.517251 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9f4e906d-4ac5-41c5-a190-288b4eda383d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:06.518212 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9f4e906d-4ac5-41c5-a190-288b4eda383d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:06.530301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9f4e906d-4ac5-41c5-a190-288b4eda383d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.531133 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9f4e906d-4ac5-41c5-a190-288b4eda383d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.531916 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9f4e906d-4ac5-41c5-a190-288b4eda383d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.533174 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9f4e906d-4ac5-41c5-a190-288b4eda383d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.534029 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9f4e906d-4ac5-41c5-a190-288b4eda383d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.534806 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9f4e906d-4ac5-41c5-a190-288b4eda383d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.572729 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-9f4e906d-4ac5-41c5-a190-288b4eda383d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lazy-loading 'flavor' on Instance uuid 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:42:06.576658 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:06.658914 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9f4e906d-4ac5-41c5-a190-288b4eda383d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "POST /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0/action" status: 202 len: 0 microversion: 2.1 time: 0.148933 Sep 01 17:42:06.660005 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 349/737] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:42:06 2022] POST /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:42:06.668713 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6b8da651-63a2-4587-aff2-2fe8962f0967 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:06.669246 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6b8da651-63a2-4587-aff2-2fe8962f0967 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:06.676166 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b8da651-63a2-4587-aff2-2fe8962f0967 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.676691 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b8da651-63a2-4587-aff2-2fe8962f0967 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.677645 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b8da651-63a2-4587-aff2-2fe8962f0967 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.677874 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b8da651-63a2-4587-aff2-2fe8962f0967 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.678347 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b8da651-63a2-4587-aff2-2fe8962f0967 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.679097 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6b8da651-63a2-4587-aff2-2fe8962f0967 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.793535 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5c9b723d-ca06-4a81-b459-e27f1ac2d1ed tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:06.794261 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5c9b723d-ca06-4a81-b459-e27f1ac2d1ed tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:06.800803 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c9b723d-ca06-4a81-b459-e27f1ac2d1ed tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.801306 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c9b723d-ca06-4a81-b459-e27f1ac2d1ed tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.802293 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c9b723d-ca06-4a81-b459-e27f1ac2d1ed tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.803016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c9b723d-ca06-4a81-b459-e27f1ac2d1ed tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.803475 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c9b723d-ca06-4a81-b459-e27f1ac2d1ed tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.803904 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c9b723d-ca06-4a81-b459-e27f1ac2d1ed tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.818248 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-6b8da651-63a2-4587-aff2-2fe8962f0967 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:06.827617 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-6b8da651-63a2-4587-aff2-2fe8962f0967 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.163160 Sep 01 17:42:06.828357 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 389/738] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:06 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:06.883817 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e90730d0-6bc6-4018-b041-323bd04d9d56 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:06.884672 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e90730d0-6bc6-4018-b041-323bd04d9d56 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:06.891370 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e90730d0-6bc6-4018-b041-323bd04d9d56 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.891976 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e90730d0-6bc6-4018-b041-323bd04d9d56 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.892526 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e90730d0-6bc6-4018-b041-323bd04d9d56 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.893451 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e90730d0-6bc6-4018-b041-323bd04d9d56 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.894007 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e90730d0-6bc6-4018-b041-323bd04d9d56 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.894507 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e90730d0-6bc6-4018-b041-323bd04d9d56 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.954012 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5c9b723d-ca06-4a81-b459-e27f1ac2d1ed tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:06.962482 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5c9b723d-ca06-4a81-b459-e27f1ac2d1ed tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:06.963938 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5c9b723d-ca06-4a81-b459-e27f1ac2d1ed tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:06.965050 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5c9b723d-ca06-4a81-b459-e27f1ac2d1ed tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1410 microversion: 2.20 time: 0.176146 Sep 01 17:42:06.965633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 350/739] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:06 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1410 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:42:07.042675 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e90730d0-6bc6-4018-b041-323bd04d9d56 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:07.050625 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e90730d0-6bc6-4018-b041-323bd04d9d56 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1512 microversion: 2.1 time: 0.171401 Sep 01 17:42:07.051201 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 390/740] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:06 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:07.410126 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9a6bd12d-f9a8-4f80-bf3f-2b6e03cdf615 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:07.410744 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9a6bd12d-f9a8-4f80-bf3f-2b6e03cdf615 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:07.417809 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a6bd12d-f9a8-4f80-bf3f-2b6e03cdf615 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:07.418300 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a6bd12d-f9a8-4f80-bf3f-2b6e03cdf615 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:07.418731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a6bd12d-f9a8-4f80-bf3f-2b6e03cdf615 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:07.419442 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a6bd12d-f9a8-4f80-bf3f-2b6e03cdf615 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:07.419900 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a6bd12d-f9a8-4f80-bf3f-2b6e03cdf615 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:07.420324 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9a6bd12d-f9a8-4f80-bf3f-2b6e03cdf615 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:07.485472 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9a6bd12d-f9a8-4f80-bf3f-2b6e03cdf615 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:07.494187 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9a6bd12d-f9a8-4f80-bf3f-2b6e03cdf615 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1241 microversion: 2.1 time: 0.087884 Sep 01 17:42:07.494827 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 351/741] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:07 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:07.849870 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5980148a-042b-4588-a30f-f6f11cd7fa44 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:07.850495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5980148a-042b-4588-a30f-f6f11cd7fa44 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:07.853382 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:07.859478 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5980148a-042b-4588-a30f-f6f11cd7fa44 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:07.859959 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5980148a-042b-4588-a30f-f6f11cd7fa44 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:07.860389 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5980148a-042b-4588-a30f-f6f11cd7fa44 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:07.861078 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5980148a-042b-4588-a30f-f6f11cd7fa44 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:07.861526 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5980148a-042b-4588-a30f-f6f11cd7fa44 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:07.861972 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5980148a-042b-4588-a30f-f6f11cd7fa44 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:07.988593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d021e3d3-bcb9-4f28-a5b1-b8bd632c759f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:07.989439 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d021e3d3-bcb9-4f28-a5b1-b8bd632c759f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:07.997869 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d021e3d3-bcb9-4f28-a5b1-b8bd632c759f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:07.998458 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d021e3d3-bcb9-4f28-a5b1-b8bd632c759f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:07.999173 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d021e3d3-bcb9-4f28-a5b1-b8bd632c759f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:08.000007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d021e3d3-bcb9-4f28-a5b1-b8bd632c759f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:08.000525 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d021e3d3-bcb9-4f28-a5b1-b8bd632c759f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:08.000891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d021e3d3-bcb9-4f28-a5b1-b8bd632c759f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:08.005568 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5980148a-042b-4588-a30f-f6f11cd7fa44 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:08.013690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5980148a-042b-4588-a30f-f6f11cd7fa44 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.168499 Sep 01 17:42:08.014279 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 391/742] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:07 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:08.072994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cc52d0b4-6971-4933-b9ba-8333c6f9ead5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:08.073655 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cc52d0b4-6971-4933-b9ba-8333c6f9ead5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:08.079538 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cc52d0b4-6971-4933-b9ba-8333c6f9ead5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:08.080052 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cc52d0b4-6971-4933-b9ba-8333c6f9ead5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:08.080440 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cc52d0b4-6971-4933-b9ba-8333c6f9ead5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:08.081135 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cc52d0b4-6971-4933-b9ba-8333c6f9ead5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:08.081767 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cc52d0b4-6971-4933-b9ba-8333c6f9ead5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:08.082120 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cc52d0b4-6971-4933-b9ba-8333c6f9ead5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:08.195203 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d021e3d3-bcb9-4f28-a5b1-b8bd632c759f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:08.206732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d021e3d3-bcb9-4f28-a5b1-b8bd632c759f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:08.208941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d021e3d3-bcb9-4f28-a5b1-b8bd632c759f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:08.210608 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d021e3d3-bcb9-4f28-a5b1-b8bd632c759f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1410 microversion: 2.20 time: 0.226661 Sep 01 17:42:08.221206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 352/743] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:07 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1410 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:42:08.269871 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cc52d0b4-6971-4933-b9ba-8333c6f9ead5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:08.280086 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cc52d0b4-6971-4933-b9ba-8333c6f9ead5 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1512 microversion: 2.1 time: 0.211214 Sep 01 17:42:08.280813 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 392/744] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:08 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1512 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:08.472776 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-fa8a7d09-739c-442c-90f0-d05ac63ba485 req-bfbc461e-aca2-415d-b21f-4da6e8df86f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3623a32e-47b4-43dc-a80b-ca4254f4eaa5", "name": "network-vif-plugged", "status": "completed", "tag": "67cfe8a5-3543-438d-a85f-436e1ad2ec3b"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:08.486542 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-fa8a7d09-739c-442c-90f0-d05ac63ba485 req-bfbc461e-aca2-415d-b21f-4da6e8df86f7 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:08.487180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-fa8a7d09-739c-442c-90f0-d05ac63ba485 req-bfbc461e-aca2-415d-b21f-4da6e8df86f7 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:08.487702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-fa8a7d09-739c-442c-90f0-d05ac63ba485 req-bfbc461e-aca2-415d-b21f-4da6e8df86f7 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:08.500297 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-fa8a7d09-739c-442c-90f0-d05ac63ba485 req-bfbc461e-aca2-415d-b21f-4da6e8df86f7 service nova] Creating event network-vif-plugged:67cfe8a5-3543-438d-a85f-436e1ad2ec3b for instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 on hv-cinder-83976 Sep 01 17:42:08.508276 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-fa8a7d09-739c-442c-90f0-d05ac63ba485 req-bfbc461e-aca2-415d-b21f-4da6e8df86f7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039978 Sep 01 17:42:08.516818 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7e9a640c-5dc2-4c86-ae23-2cead692f424 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:08.518148 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7e9a640c-5dc2-4c86-ae23-2cead692f424 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:08.519003 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 353/745] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:08.540882 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7e9a640c-5dc2-4c86-ae23-2cead692f424 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:08.542349 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7e9a640c-5dc2-4c86-ae23-2cead692f424 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:08.543112 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7e9a640c-5dc2-4c86-ae23-2cead692f424 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:08.547234 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7e9a640c-5dc2-4c86-ae23-2cead692f424 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:08.548442 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7e9a640c-5dc2-4c86-ae23-2cead692f424 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:08.553631 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7e9a640c-5dc2-4c86-ae23-2cead692f424 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:08.645063 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-381fa673-19b3-42fd-a87b-cfb101d1d25d req-44e9da0d-562c-43ca-b573-a7e4ed47fa2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2905128c-3c89-498f-92c1-7c4bce87f75c", "name": "network-vif-deleted", "tag": "f202a908-6c12-487f-a321-2dd4650a0faf"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:08.676425 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-381fa673-19b3-42fd-a87b-cfb101d1d25d req-44e9da0d-562c-43ca-b573-a7e4ed47fa2c service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:08.677318 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-381fa673-19b3-42fd-a87b-cfb101d1d25d req-44e9da0d-562c-43ca-b573-a7e4ed47fa2c service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:08.678117 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-381fa673-19b3-42fd-a87b-cfb101d1d25d req-44e9da0d-562c-43ca-b573-a7e4ed47fa2c service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:08.691598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7e9a640c-5dc2-4c86-ae23-2cead692f424 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:08.695918 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-381fa673-19b3-42fd-a87b-cfb101d1d25d req-44e9da0d-562c-43ca-b573-a7e4ed47fa2c service nova] Creating event network-vif-deleted:f202a908-6c12-487f-a321-2dd4650a0faf for instance 2905128c-3c89-498f-92c1-7c4bce87f75c on hv-cinder-83976 Sep 01 17:42:08.701675 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7e9a640c-5dc2-4c86-ae23-2cead692f424 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1297 microversion: 2.1 time: 0.189379 Sep 01 17:42:08.702905 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 393/746] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:08 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1297 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:08.707224 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-381fa673-19b3-42fd-a87b-cfb101d1d25d req-44e9da0d-562c-43ca-b573-a7e4ed47fa2c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072113 Sep 01 17:42:08.709220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 354/747] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:09.039598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5f4b366f-300f-49bb-8623-bb66ff1f4c32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:09.040376 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5f4b366f-300f-49bb-8623-bb66ff1f4c32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:09.047238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f4b366f-300f-49bb-8623-bb66ff1f4c32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:09.047895 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f4b366f-300f-49bb-8623-bb66ff1f4c32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:09.048396 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f4b366f-300f-49bb-8623-bb66ff1f4c32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:09.049174 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f4b366f-300f-49bb-8623-bb66ff1f4c32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:09.049723 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f4b366f-300f-49bb-8623-bb66ff1f4c32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:09.050469 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5f4b366f-300f-49bb-8623-bb66ff1f4c32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:09.201312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5f4b366f-300f-49bb-8623-bb66ff1f4c32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:09.211745 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5f4b366f-300f-49bb-8623-bb66ff1f4c32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.176587 Sep 01 17:42:09.212504 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 394/748] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:09 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:09.235370 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-0b369c8e-9435-4999-b9dc-3fc2e7d8bd6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:09.236669 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-0b369c8e-9435-4999-b9dc-3fc2e7d8bd6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:09.248588 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0b369c8e-9435-4999-b9dc-3fc2e7d8bd6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:09.249196 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0b369c8e-9435-4999-b9dc-3fc2e7d8bd6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:09.249855 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0b369c8e-9435-4999-b9dc-3fc2e7d8bd6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:09.251115 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0b369c8e-9435-4999-b9dc-3fc2e7d8bd6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:09.251979 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0b369c8e-9435-4999-b9dc-3fc2e7d8bd6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:09.252788 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0b369c8e-9435-4999-b9dc-3fc2e7d8bd6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:09.303317 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:09.304518 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:09.311344 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:09.311929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:09.312585 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:09.313368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:09.313927 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:09.314424 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:09.349478 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:09.350105 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:09.350642 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:09.351161 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lazy-loading 'fault' on Instance uuid 2905128c-3c89-498f-92c1-7c4bce87f75c {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:42:09.404561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:09.413411 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1cb70cb7-17f5-4f08-be14-837aeeaedb86 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1315 microversion: 2.1 time: 0.115300 Sep 01 17:42:09.414471 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 395/749] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:09 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1315 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:09.464899 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-0b369c8e-9435-4999-b9dc-3fc2e7d8bd6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:09.473423 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-0b369c8e-9435-4999-b9dc-3fc2e7d8bd6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:09.475016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-0b369c8e-9435-4999-b9dc-3fc2e7d8bd6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:09.476176 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-0b369c8e-9435-4999-b9dc-3fc2e7d8bd6d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1410 microversion: 2.20 time: 0.247405 Sep 01 17:42:09.476734 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 355/750] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:09 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1410 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:09.725776 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5353fa04-a6a0-4041-9f06-dce3bdcc2f15 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:09.726263 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5353fa04-a6a0-4041-9f06-dce3bdcc2f15 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:09.733275 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5353fa04-a6a0-4041-9f06-dce3bdcc2f15 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:09.734166 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5353fa04-a6a0-4041-9f06-dce3bdcc2f15 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:09.734849 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5353fa04-a6a0-4041-9f06-dce3bdcc2f15 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:09.735579 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5353fa04-a6a0-4041-9f06-dce3bdcc2f15 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:09.736036 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5353fa04-a6a0-4041-9f06-dce3bdcc2f15 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:09.736449 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5353fa04-a6a0-4041-9f06-dce3bdcc2f15 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:09.876564 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5353fa04-a6a0-4041-9f06-dce3bdcc2f15 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:09.885829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5353fa04-a6a0-4041-9f06-dce3bdcc2f15 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1371 microversion: 2.1 time: 0.165003 Sep 01 17:42:09.886420 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 396/751] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:09 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:10.234402 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d16da977-1a33-42bb-96ea-8a9b6bf7d8c7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:10.234794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d16da977-1a33-42bb-96ea-8a9b6bf7d8c7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:10.242592 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d16da977-1a33-42bb-96ea-8a9b6bf7d8c7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.243196 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d16da977-1a33-42bb-96ea-8a9b6bf7d8c7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.243414 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d16da977-1a33-42bb-96ea-8a9b6bf7d8c7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.244106 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d16da977-1a33-42bb-96ea-8a9b6bf7d8c7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.244556 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d16da977-1a33-42bb-96ea-8a9b6bf7d8c7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.244975 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d16da977-1a33-42bb-96ea-8a9b6bf7d8c7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.384983 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d16da977-1a33-42bb-96ea-8a9b6bf7d8c7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:10.393223 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d16da977-1a33-42bb-96ea-8a9b6bf7d8c7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.162754 Sep 01 17:42:10.393853 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 356/752] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:10 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:10.436540 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:10.437272 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:10.444474 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.444969 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.445407 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.446164 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.446618 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.447041 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.482360 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.483174 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.483614 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.484067 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lazy-loading 'fault' on Instance uuid 2905128c-3c89-498f-92c1-7c4bce87f75c {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:42:10.499791 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a6328bfc-d8db-4f18-b262-df04315894c6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:10.500350 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a6328bfc-d8db-4f18-b262-df04315894c6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:10.508264 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a6328bfc-d8db-4f18-b262-df04315894c6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.508756 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a6328bfc-d8db-4f18-b262-df04315894c6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.509194 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a6328bfc-d8db-4f18-b262-df04315894c6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.510137 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a6328bfc-d8db-4f18-b262-df04315894c6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.510592 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a6328bfc-d8db-4f18-b262-df04315894c6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.511022 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a6328bfc-d8db-4f18-b262-df04315894c6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.530543 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:10.542452 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5330c77a-81fb-48b0-8264-d601261dea73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 200 len: 1315 microversion: 2.1 time: 0.110137 Sep 01 17:42:10.543328 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 397/753] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:10 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 1315 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:10.705629 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a6328bfc-d8db-4f18-b262-df04315894c6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:10.714947 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a6328bfc-d8db-4f18-b262-df04315894c6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:10.716441 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a6328bfc-d8db-4f18-b262-df04315894c6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:10.717785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a6328bfc-d8db-4f18-b262-df04315894c6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1602 microversion: 2.20 time: 0.221912 Sep 01 17:42:10.718806 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 357/754] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:10 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1602 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:10.741347 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-dd1e66fb-a37e-4644-9a58-833405e8769e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:10.741955 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-dd1e66fb-a37e-4644-9a58-833405e8769e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:10.747970 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dd1e66fb-a37e-4644-9a58-833405e8769e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.748523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dd1e66fb-a37e-4644-9a58-833405e8769e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.748961 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dd1e66fb-a37e-4644-9a58-833405e8769e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.749688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dd1e66fb-a37e-4644-9a58-833405e8769e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.750203 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dd1e66fb-a37e-4644-9a58-833405e8769e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.750567 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dd1e66fb-a37e-4644-9a58-833405e8769e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.842329 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-70a48fb8-1a7b-4da6-a98a-d98714560f10 req-c7d70116-0d75-43c0-a89a-12be9bddae5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72608990-e16b-4544-9ce6-d340d1c8c577", "tag": "ec544ef7-b677-4f1d-8569-ad70326adfd8"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:10.858075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-70a48fb8-1a7b-4da6-a98a-d98714560f10 req-c7d70116-0d75-43c0-a89a-12be9bddae5f service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.858962 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-70a48fb8-1a7b-4da6-a98a-d98714560f10 req-c7d70116-0d75-43c0-a89a-12be9bddae5f service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.859471 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-70a48fb8-1a7b-4da6-a98a-d98714560f10 req-c7d70116-0d75-43c0-a89a-12be9bddae5f service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.882443 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-70a48fb8-1a7b-4da6-a98a-d98714560f10 req-c7d70116-0d75-43c0-a89a-12be9bddae5f service nova] Creating event network-changed:ec544ef7-b677-4f1d-8569-ad70326adfd8 for instance 72608990-e16b-4544-9ce6-d340d1c8c577 on hv-cinder-83976 Sep 01 17:42:10.887715 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-70a48fb8-1a7b-4da6-a98a-d98714560f10 req-c7d70116-0d75-43c0-a89a-12be9bddae5f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050929 Sep 01 17:42:10.888607 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 358/755] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:10.909036 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c8f0284b-b386-4112-aa47-0b8a99aa2294 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:10.909784 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c8f0284b-b386-4112-aa47-0b8a99aa2294 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:10.918116 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c8f0284b-b386-4112-aa47-0b8a99aa2294 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.918664 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c8f0284b-b386-4112-aa47-0b8a99aa2294 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.919135 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c8f0284b-b386-4112-aa47-0b8a99aa2294 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.919837 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c8f0284b-b386-4112-aa47-0b8a99aa2294 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.920288 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c8f0284b-b386-4112-aa47-0b8a99aa2294 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.920708 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c8f0284b-b386-4112-aa47-0b8a99aa2294 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:11.111255 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-dd1e66fb-a37e-4644-9a58-833405e8769e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.374347 Sep 01 17:42:11.112527 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 398/756] 10.222.0.100 () {60 vars in 1321 bytes} [Thu Sep 1 17:42:10 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/os-interface => generated 284 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:42:11.178947 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c8f0284b-b386-4112-aa47-0b8a99aa2294 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:11.186667 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c8f0284b-b386-4112-aa47-0b8a99aa2294 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1371 microversion: 2.1 time: 0.281970 Sep 01 17:42:11.187243 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 359/757] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:10 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:11.414903 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-52872254-bc9b-4785-a27a-5d441c71a6bd tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:11.415541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-52872254-bc9b-4785-a27a-5d441c71a6bd tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:11.421471 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52872254-bc9b-4785-a27a-5d441c71a6bd tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:11.421997 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52872254-bc9b-4785-a27a-5d441c71a6bd tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:11.422432 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52872254-bc9b-4785-a27a-5d441c71a6bd tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:11.423122 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52872254-bc9b-4785-a27a-5d441c71a6bd tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:11.423582 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52872254-bc9b-4785-a27a-5d441c71a6bd tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:11.424002 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-52872254-bc9b-4785-a27a-5d441c71a6bd tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:11.438522 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4a29738a-d275-4f50-b608-639c0681130a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1796462018"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:11.439068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4a29738a-d275-4f50-b608-639c0681130a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:11.446678 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a29738a-d275-4f50-b608-639c0681130a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:11.447520 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a29738a-d275-4f50-b608-639c0681130a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:11.448211 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a29738a-d275-4f50-b608-639c0681130a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:11.449102 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a29738a-d275-4f50-b608-639c0681130a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:11.449640 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a29738a-d275-4f50-b608-639c0681130a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:11.450124 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4a29738a-d275-4f50-b608-639c0681130a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:11.639472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-52872254-bc9b-4785-a27a-5d441c71a6bd tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:11.647678 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-52872254-bc9b-4785-a27a-5d441c71a6bd tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.237023 Sep 01 17:42:11.648290 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 399/758] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:11 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:11.656186 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-acd45fb9-34df-4d91-bcb6-f066f2a0bbe1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:11.657054 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-acd45fb9-34df-4d91-bcb6-f066f2a0bbe1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 2905128c-3c89-498f-92c1-7c4bce87f75c] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:11.670165 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.network.security_group_api [None req-4a29738a-d275-4f50-b608-639c0681130a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Removing security group 086535f6-ddf1-49b5-a62f-5ae9c8494b96 from port 43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c Sep 01 17:42:11.670359 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-acd45fb9-34df-4d91-bcb6-f066f2a0bbe1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:11.670714 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-acd45fb9-34df-4d91-bcb6-f066f2a0bbe1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:11.671215 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-acd45fb9-34df-4d91-bcb6-f066f2a0bbe1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:11.671918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-acd45fb9-34df-4d91-bcb6-f066f2a0bbe1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:11.672370 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-acd45fb9-34df-4d91-bcb6-f066f2a0bbe1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:11.672788 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-acd45fb9-34df-4d91-bcb6-f066f2a0bbe1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:11.688796 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-acd45fb9-34df-4d91-bcb6-f066f2a0bbe1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] HTTP exception thrown: Instance 2905128c-3c89-498f-92c1-7c4bce87f75c could not be found. Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-acd45fb9-34df-4d91-bcb6-f066f2a0bbe1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Request method failure captured: Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c HTTP/1.1 Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2m8zyf1MdfI9Plug8mrFjRApjQ5c-8jQisg1PVk0tj5vFsUELO_1M1udUcyP_UxAfWvOWoJ8fDtqa8LTzrnjXG6uPV0irrnSvS-1H3XCvA0zw3nvSo7ARUEiib2-x1XXV_v7wdYFSh1m3JfZWwThjo3uq-lxNxGev-IFpfAVdzDqI Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: b01df46ff9744c2f830459547d7e4dd6 Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:42:11.690484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:42:11.692079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:42:11.692079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:42:11.692079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: b01df46ff9744c2f830459547d7e4dd6 Sep 01 17:42:11.692079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:42:11.692079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-ServerRescueNegativeTestJSON-1908064911-project Sep 01 17:42:11.692079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:42:11.692079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:42:11.692079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: 5647214c5b3f438eb3ef1ddc14153d9e Sep 01 17:42:11.692079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1908064911-project Sep 01 17:42:11.692079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:42:11.692079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 2905128c-3c89-498f-92c1-7c4bce87f75c could not be found. Sep 01 17:42:11.692079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '2905128c-3c89-498f-92c1-7c4bce87f75c'} Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2905128c-3c89-498f-92c1-7c4bce87f75c could not be found. Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:42:11.693888 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2905128c-3c89-498f-92c1-7c4bce87f75c could not be found. Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2905128c-3c89-498f-92c1-7c4bce87f75c could not be found. Sep 01 17:42:11.695319 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:11.696576 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-acd45fb9-34df-4d91-bcb6-f066f2a0bbe1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Returning 404 to user: Instance 2905128c-3c89-498f-92c1-7c4bce87f75c could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:42:11.696576 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-acd45fb9-34df-4d91-bcb6-f066f2a0bbe1 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c" status: 404 len: 111 microversion: 2.1 time: 0.042470 Sep 01 17:42:11.696576 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 400/759] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:11 2022] GET /compute/v2.1/servers/2905128c-3c89-498f-92c1-7c4bce87f75c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:42:11.704984 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2d50e568-c1f3-4bf6-b246-8d57848459f7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:11.705878 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2d50e568-c1f3-4bf6-b246-8d57848459f7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:11.714560 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d50e568-c1f3-4bf6-b246-8d57848459f7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:11.715848 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d50e568-c1f3-4bf6-b246-8d57848459f7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:11.716477 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d50e568-c1f3-4bf6-b246-8d57848459f7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:11.717345 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d50e568-c1f3-4bf6-b246-8d57848459f7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:11.718214 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d50e568-c1f3-4bf6-b246-8d57848459f7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:11.718801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d50e568-c1f3-4bf6-b246-8d57848459f7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:11.751957 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2d50e568-c1f3-4bf6-b246-8d57848459f7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Going to try to terminate instance {{(pid=127233) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:42:11.801393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:11.837821 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2d50e568-c1f3-4bf6-b246-8d57848459f7 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 204 len: 0 microversion: 2.1 time: 0.136068 Sep 01 17:42:11.838744 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 401/760] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:42:11 2022] DELETE /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 17:42:11.847094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f4622627-3a40-41af-93ed-978ea2e3e6a3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:11.848327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f4622627-3a40-41af-93ed-978ea2e3e6a3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:11.855864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f4622627-3a40-41af-93ed-978ea2e3e6a3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:11.856499 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f4622627-3a40-41af-93ed-978ea2e3e6a3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:11.856992 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f4622627-3a40-41af-93ed-978ea2e3e6a3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:11.857920 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f4622627-3a40-41af-93ed-978ea2e3e6a3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:11.858380 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f4622627-3a40-41af-93ed-978ea2e3e6a3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:11.858801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f4622627-3a40-41af-93ed-978ea2e3e6a3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:12.086375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f4622627-3a40-41af-93ed-978ea2e3e6a3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:12.097868 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4a29738a-d275-4f50-b608-639c0681130a tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "POST /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/action" status: 202 len: 0 microversion: 2.1 time: 0.663191 Sep 01 17:42:12.102981 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 360/761] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:42:11 2022] POST /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:42:12.104392 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f4622627-3a40-41af-93ed-978ea2e3e6a3 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.261238 Sep 01 17:42:12.118286 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 402/762] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:11 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:12.129542 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-bb9c3252-bd05-4141-877a-0cfd3f040257 req-1f14d749-6a86-4ee7-8caa-376b805f60a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c4d577-d281-42b7-b448-d38b39a7ee39", "tag": "43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:12.149143 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-bb9c3252-bd05-4141-877a-0cfd3f040257 req-1f14d749-6a86-4ee7-8caa-376b805f60a2 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:12.150366 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-bb9c3252-bd05-4141-877a-0cfd3f040257 req-1f14d749-6a86-4ee7-8caa-376b805f60a2 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:12.151030 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-bb9c3252-bd05-4141-877a-0cfd3f040257 req-1f14d749-6a86-4ee7-8caa-376b805f60a2 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:12.170874 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-bb9c3252-bd05-4141-877a-0cfd3f040257 req-1f14d749-6a86-4ee7-8caa-376b805f60a2 service nova] Creating event network-changed:43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c for instance 14c4d577-d281-42b7-b448-d38b39a7ee39 on hv-cinder-83976 Sep 01 17:42:12.177464 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-bb9c3252-bd05-4141-877a-0cfd3f040257 req-1f14d749-6a86-4ee7-8caa-376b805f60a2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053645 Sep 01 17:42:12.178385 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 361/763] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:12.208532 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-24252055-d9a4-4edc-a8d1-e6bf44468ccb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:12.209592 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-24252055-d9a4-4edc-a8d1-e6bf44468ccb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:12.215785 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-24252055-d9a4-4edc-a8d1-e6bf44468ccb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:12.216509 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-24252055-d9a4-4edc-a8d1-e6bf44468ccb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:12.217103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-24252055-d9a4-4edc-a8d1-e6bf44468ccb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:12.218018 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-24252055-d9a4-4edc-a8d1-e6bf44468ccb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:12.218628 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-24252055-d9a4-4edc-a8d1-e6bf44468ccb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:12.219210 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-24252055-d9a4-4edc-a8d1-e6bf44468ccb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:12.531197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-24252055-d9a4-4edc-a8d1-e6bf44468ccb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:12.543673 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-24252055-d9a4-4edc-a8d1-e6bf44468ccb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1371 microversion: 2.1 time: 0.338234 Sep 01 17:42:12.549743 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 403/764] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:12 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1371 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:12.672518 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9f90bd84-73fc-44ef-a2cc-32f5f49336a4 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:12.673208 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9f90bd84-73fc-44ef-a2cc-32f5f49336a4 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:12.680200 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9f90bd84-73fc-44ef-a2cc-32f5f49336a4 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:12.680974 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9f90bd84-73fc-44ef-a2cc-32f5f49336a4 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:12.681403 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9f90bd84-73fc-44ef-a2cc-32f5f49336a4 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:12.682142 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9f90bd84-73fc-44ef-a2cc-32f5f49336a4 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:12.682593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9f90bd84-73fc-44ef-a2cc-32f5f49336a4 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:12.683021 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9f90bd84-73fc-44ef-a2cc-32f5f49336a4 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:12.839130 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9f90bd84-73fc-44ef-a2cc-32f5f49336a4 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:12.847382 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9f90bd84-73fc-44ef-a2cc-32f5f49336a4 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.179417 Sep 01 17:42:12.848527 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 362/765] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:12 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:12.914086 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-9667b362-3663-46e8-8cfb-a63758279ef5 req-18411f50-9ce7-4815-b2a4-cdb0a7e1a008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3623a32e-47b4-43dc-a80b-ca4254f4eaa5", "tag": "67cfe8a5-3543-438d-a85f-436e1ad2ec3b"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:12.924889 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-9667b362-3663-46e8-8cfb-a63758279ef5 req-18411f50-9ce7-4815-b2a4-cdb0a7e1a008 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:12.925391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-9667b362-3663-46e8-8cfb-a63758279ef5 req-18411f50-9ce7-4815-b2a4-cdb0a7e1a008 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:12.926005 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-9667b362-3663-46e8-8cfb-a63758279ef5 req-18411f50-9ce7-4815-b2a4-cdb0a7e1a008 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:12.940046 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-9667b362-3663-46e8-8cfb-a63758279ef5 req-18411f50-9ce7-4815-b2a4-cdb0a7e1a008 service nova] Creating event network-changed:67cfe8a5-3543-438d-a85f-436e1ad2ec3b for instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 on hv-cinder-83976 Sep 01 17:42:12.945956 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-9667b362-3663-46e8-8cfb-a63758279ef5 req-18411f50-9ce7-4815-b2a4-cdb0a7e1a008 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036384 Sep 01 17:42:12.946560 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 404/766] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:42:13.125160 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ab56ba68-6053-495a-bf3c-002f384d9160 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:13.125959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ab56ba68-6053-495a-bf3c-002f384d9160 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:13.133027 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ab56ba68-6053-495a-bf3c-002f384d9160 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:13.133865 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ab56ba68-6053-495a-bf3c-002f384d9160 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:13.134494 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ab56ba68-6053-495a-bf3c-002f384d9160 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:13.135630 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ab56ba68-6053-495a-bf3c-002f384d9160 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:13.136211 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ab56ba68-6053-495a-bf3c-002f384d9160 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:13.136781 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ab56ba68-6053-495a-bf3c-002f384d9160 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:13.283309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ab56ba68-6053-495a-bf3c-002f384d9160 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:13.292810 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ab56ba68-6053-495a-bf3c-002f384d9160 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.171598 Sep 01 17:42:13.293385 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 363/767] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:13 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:13.402242 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f64a67b6-ec47-475e-a796-742043f1951c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:13.402770 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f64a67b6-ec47-475e-a796-742043f1951c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:13.409511 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f64a67b6-ec47-475e-a796-742043f1951c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:13.410050 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f64a67b6-ec47-475e-a796-742043f1951c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:13.410493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f64a67b6-ec47-475e-a796-742043f1951c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:13.412139 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f64a67b6-ec47-475e-a796-742043f1951c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:13.412285 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f64a67b6-ec47-475e-a796-742043f1951c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:13.412601 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f64a67b6-ec47-475e-a796-742043f1951c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:13.514994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-f64a67b6-ec47-475e-a796-742043f1951c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lazy-loading 'services' on Instance uuid 14c4d577-d281-42b7-b448-d38b39a7ee39 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:42:13.564050 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4f68846f-5b8b-42fc-a25b-d7b4bc862987 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:13.564667 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4f68846f-5b8b-42fc-a25b-d7b4bc862987 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:13.574209 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f68846f-5b8b-42fc-a25b-d7b4bc862987 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:13.574605 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f68846f-5b8b-42fc-a25b-d7b4bc862987 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:13.575089 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f68846f-5b8b-42fc-a25b-d7b4bc862987 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:13.575854 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f68846f-5b8b-42fc-a25b-d7b4bc862987 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:13.576291 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f68846f-5b8b-42fc-a25b-d7b4bc862987 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:13.576719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f68846f-5b8b-42fc-a25b-d7b4bc862987 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:13.618289 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f64a67b6-ec47-475e-a796-742043f1951c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "DELETE /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments/7555b696-f5de-4888-8995-adbacd6351eb" status: 202 len: 0 microversion: 2.1 time: 0.220286 Sep 01 17:42:13.619075 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 405/768] 10.222.0.100 () {58 vars in 1421 bytes} [Thu Sep 1 17:42:13 2022] DELETE /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments/7555b696-f5de-4888-8995-adbacd6351eb => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:42:13.629680 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-66ea083a-8313-4ba9-b452-4d4456d7cc48 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:13.632032 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-66ea083a-8313-4ba9-b452-4d4456d7cc48 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:13.638851 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-66ea083a-8313-4ba9-b452-4d4456d7cc48 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:13.639561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-66ea083a-8313-4ba9-b452-4d4456d7cc48 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:13.640314 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-66ea083a-8313-4ba9-b452-4d4456d7cc48 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:13.641327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-66ea083a-8313-4ba9-b452-4d4456d7cc48 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:13.641923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-66ea083a-8313-4ba9-b452-4d4456d7cc48 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:13.642440 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-66ea083a-8313-4ba9-b452-4d4456d7cc48 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:13.686113 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-66ea083a-8313-4ba9-b452-4d4456d7cc48 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061621 Sep 01 17:42:13.687180 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 406/769] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:42:13 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:13.726723 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4f68846f-5b8b-42fc-a25b-d7b4bc862987 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:13.737132 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4f68846f-5b8b-42fc-a25b-d7b4bc862987 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1371 microversion: 2.1 time: 0.176604 Sep 01 17:42:13.738077 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 364/770] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:13 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:13.869684 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-663caf34-50e6-43a6-9a8f-339265d10cb8 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:13.870205 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-663caf34-50e6-43a6-9a8f-339265d10cb8 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:13.876047 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-663caf34-50e6-43a6-9a8f-339265d10cb8 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:13.876530 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-663caf34-50e6-43a6-9a8f-339265d10cb8 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:13.876964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-663caf34-50e6-43a6-9a8f-339265d10cb8 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:13.877687 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-663caf34-50e6-43a6-9a8f-339265d10cb8 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:13.878143 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-663caf34-50e6-43a6-9a8f-339265d10cb8 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:13.878565 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-663caf34-50e6-43a6-9a8f-339265d10cb8 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:14.021183 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-663caf34-50e6-43a6-9a8f-339265d10cb8 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:14.028953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-663caf34-50e6-43a6-9a8f-339265d10cb8 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.163166 Sep 01 17:42:14.029535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 407/771] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:13 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:14.315152 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e109ddc7-46cc-4f90-a051-c7bb9ed4e119 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:14.315743 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e109ddc7-46cc-4f90-a051-c7bb9ed4e119 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:14.322785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e109ddc7-46cc-4f90-a051-c7bb9ed4e119 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:14.323272 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e109ddc7-46cc-4f90-a051-c7bb9ed4e119 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:14.323962 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e109ddc7-46cc-4f90-a051-c7bb9ed4e119 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:14.324669 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e109ddc7-46cc-4f90-a051-c7bb9ed4e119 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:14.325119 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e109ddc7-46cc-4f90-a051-c7bb9ed4e119 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:14.325541 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e109ddc7-46cc-4f90-a051-c7bb9ed4e119 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:14.470588 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e109ddc7-46cc-4f90-a051-c7bb9ed4e119 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:14.480182 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e109ddc7-46cc-4f90-a051-c7bb9ed4e119 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.168988 Sep 01 17:42:14.481099 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 365/772] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:14 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:14.701148 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7dc07aac-b716-45a5-8c73-45c545eecfa0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:14.703744 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7dc07aac-b716-45a5-8c73-45c545eecfa0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:14.710684 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7dc07aac-b716-45a5-8c73-45c545eecfa0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:14.711179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7dc07aac-b716-45a5-8c73-45c545eecfa0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:14.711621 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7dc07aac-b716-45a5-8c73-45c545eecfa0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:14.712337 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7dc07aac-b716-45a5-8c73-45c545eecfa0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:14.712797 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7dc07aac-b716-45a5-8c73-45c545eecfa0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:14.713262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7dc07aac-b716-45a5-8c73-45c545eecfa0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:14.747615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7dc07aac-b716-45a5-8c73-45c545eecfa0 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051162 Sep 01 17:42:14.748200 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 408/773] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:42:14 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:14.759067 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e8882560-a1ea-4f57-8f73-9919bba250a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:14.759796 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e8882560-a1ea-4f57-8f73-9919bba250a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:14.767956 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e8882560-a1ea-4f57-8f73-9919bba250a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:14.768446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e8882560-a1ea-4f57-8f73-9919bba250a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:14.768881 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e8882560-a1ea-4f57-8f73-9919bba250a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:14.769639 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e8882560-a1ea-4f57-8f73-9919bba250a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:14.770094 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e8882560-a1ea-4f57-8f73-9919bba250a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:14.770681 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e8882560-a1ea-4f57-8f73-9919bba250a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:14.908272 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e8882560-a1ea-4f57-8f73-9919bba250a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:14.917034 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e8882560-a1ea-4f57-8f73-9919bba250a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1371 microversion: 2.1 time: 0.162739 Sep 01 17:42:14.917634 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 366/774] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:14 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:14.975825 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-606aaa41-e3f4-4d2d-a459-e52ffb9f9a34 req-3b52a3e6-b07d-41de-9905-9f73b15427c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c4d577-d281-42b7-b448-d38b39a7ee39", "tag": "43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:14.985373 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-606aaa41-e3f4-4d2d-a459-e52ffb9f9a34 req-3b52a3e6-b07d-41de-9905-9f73b15427c1 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:14.985880 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-606aaa41-e3f4-4d2d-a459-e52ffb9f9a34 req-3b52a3e6-b07d-41de-9905-9f73b15427c1 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:14.986306 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-606aaa41-e3f4-4d2d-a459-e52ffb9f9a34 req-3b52a3e6-b07d-41de-9905-9f73b15427c1 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:14.999820 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-606aaa41-e3f4-4d2d-a459-e52ffb9f9a34 req-3b52a3e6-b07d-41de-9905-9f73b15427c1 service nova] Creating event network-changed:43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c for instance 14c4d577-d281-42b7-b448-d38b39a7ee39 on hv-cinder-83976 Sep 01 17:42:15.004459 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-606aaa41-e3f4-4d2d-a459-e52ffb9f9a34 req-3b52a3e6-b07d-41de-9905-9f73b15427c1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033328 Sep 01 17:42:15.005116 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 409/775] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:15.050777 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a3189a31-f534-4290-8a63-3c3d0b13266c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:15.054368 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a3189a31-f534-4290-8a63-3c3d0b13266c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:15.059064 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a3189a31-f534-4290-8a63-3c3d0b13266c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:15.059592 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a3189a31-f534-4290-8a63-3c3d0b13266c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:15.060027 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a3189a31-f534-4290-8a63-3c3d0b13266c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:15.060721 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a3189a31-f534-4290-8a63-3c3d0b13266c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:15.061170 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a3189a31-f534-4290-8a63-3c3d0b13266c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:15.061600 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a3189a31-f534-4290-8a63-3c3d0b13266c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:15.080635 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:15.209556 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a3189a31-f534-4290-8a63-3c3d0b13266c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:15.217311 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a3189a31-f534-4290-8a63-3c3d0b13266c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.170688 Sep 01 17:42:15.217916 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 367/776] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:15 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:15.500663 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:15.501853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=10 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:15.508436 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0f8ba7b3-fb4d-4306-9a53-12267a507a53 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:15.509237 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0f8ba7b3-fb4d-4306-9a53-12267a507a53 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:15.518568 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f8ba7b3-fb4d-4306-9a53-12267a507a53 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:15.519054 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f8ba7b3-fb4d-4306-9a53-12267a507a53 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:15.519554 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f8ba7b3-fb4d-4306-9a53-12267a507a53 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:15.520286 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f8ba7b3-fb4d-4306-9a53-12267a507a53 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:15.521810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f8ba7b3-fb4d-4306-9a53-12267a507a53 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:15.522269 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0f8ba7b3-fb4d-4306-9a53-12267a507a53 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:15.676248 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0f8ba7b3-fb4d-4306-9a53-12267a507a53 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:15.685195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0f8ba7b3-fb4d-4306-9a53-12267a507a53 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.186247 Sep 01 17:42:15.685919 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 410/777] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:15 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:15.761222 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-0489c178-d42e-4c5c-91a3-b639571dcd1d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:15.763464 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-0489c178-d42e-4c5c-91a3-b639571dcd1d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:15.765328 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:15.771980 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0489c178-d42e-4c5c-91a3-b639571dcd1d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:15.772462 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0489c178-d42e-4c5c-91a3-b639571dcd1d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:15.772898 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0489c178-d42e-4c5c-91a3-b639571dcd1d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:15.773622 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0489c178-d42e-4c5c-91a3-b639571dcd1d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:15.774083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0489c178-d42e-4c5c-91a3-b639571dcd1d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:15.774516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0489c178-d42e-4c5c-91a3-b639571dcd1d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:15.804826 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-0489c178-d42e-4c5c-91a3-b639571dcd1d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047659 Sep 01 17:42:15.805387 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 368/778] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:42:15 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:15.938197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d052fc4e-93de-46fa-813e-fa554e6786ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:15.938818 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d052fc4e-93de-46fa-813e-fa554e6786ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:15.946920 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d052fc4e-93de-46fa-813e-fa554e6786ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:15.947590 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d052fc4e-93de-46fa-813e-fa554e6786ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:15.948220 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d052fc4e-93de-46fa-813e-fa554e6786ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:15.948929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d052fc4e-93de-46fa-813e-fa554e6786ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:15.949385 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d052fc4e-93de-46fa-813e-fa554e6786ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:15.949837 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d052fc4e-93de-46fa-813e-fa554e6786ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:16.245735 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c2e1fb52-782f-4d74-930e-c3a727f5016d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:16.247020 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c2e1fb52-782f-4d74-930e-c3a727f5016d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:16.258812 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c2e1fb52-782f-4d74-930e-c3a727f5016d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:16.259505 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c2e1fb52-782f-4d74-930e-c3a727f5016d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:16.260063 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c2e1fb52-782f-4d74-930e-c3a727f5016d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:16.260914 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c2e1fb52-782f-4d74-930e-c3a727f5016d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:16.261803 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c2e1fb52-782f-4d74-930e-c3a727f5016d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:16.262305 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c2e1fb52-782f-4d74-930e-c3a727f5016d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:16.307056 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d052fc4e-93de-46fa-813e-fa554e6786ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:16.319814 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d052fc4e-93de-46fa-813e-fa554e6786ce tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1371 microversion: 2.1 time: 0.385425 Sep 01 17:42:16.335131 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 411/779] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:15 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:16.563581 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-4f93f964-042f-49bd-b308-4005157e162b req-e3347539-0592-4e91-91f1-8d0099bd6cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72608990-e16b-4544-9ce6-d340d1c8c577", "name": "network-vif-plugged", "status": "completed", "tag": "ec544ef7-b677-4f1d-8569-ad70326adfd8"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:16.586580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-4f93f964-042f-49bd-b308-4005157e162b req-e3347539-0592-4e91-91f1-8d0099bd6cdc service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:16.587492 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-4f93f964-042f-49bd-b308-4005157e162b req-e3347539-0592-4e91-91f1-8d0099bd6cdc service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:16.590412 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-4f93f964-042f-49bd-b308-4005157e162b req-e3347539-0592-4e91-91f1-8d0099bd6cdc service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:16.595290 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c2e1fb52-782f-4d74-930e-c3a727f5016d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:16.615301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c2e1fb52-782f-4d74-930e-c3a727f5016d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.378947 Sep 01 17:42:16.616166 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 369/780] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:16 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:16.618361 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-4f93f964-042f-49bd-b308-4005157e162b req-e3347539-0592-4e91-91f1-8d0099bd6cdc service nova] Creating event network-vif-plugged:ec544ef7-b677-4f1d-8569-ad70326adfd8 for instance 72608990-e16b-4544-9ce6-d340d1c8c577 on hv-cinder-83976 Sep 01 17:42:16.632706 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-4f93f964-042f-49bd-b308-4005157e162b req-e3347539-0592-4e91-91f1-8d0099bd6cdc service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082675 Sep 01 17:42:16.633625 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 412/781] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:16.706421 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a9c92a24-95ef-4637-8b30-ec9011b9e69a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:16.707042 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a9c92a24-95ef-4637-8b30-ec9011b9e69a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:16.717785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9c92a24-95ef-4637-8b30-ec9011b9e69a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:16.718513 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9c92a24-95ef-4637-8b30-ec9011b9e69a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:16.719054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9c92a24-95ef-4637-8b30-ec9011b9e69a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:16.719942 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9c92a24-95ef-4637-8b30-ec9011b9e69a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:16.720465 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9c92a24-95ef-4637-8b30-ec9011b9e69a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:16.720951 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9c92a24-95ef-4637-8b30-ec9011b9e69a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:16.819856 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0d5a8ecd-d2d1-497d-a30f-b7e352126c4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:16.822325 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0d5a8ecd-d2d1-497d-a30f-b7e352126c4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:16.829823 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0d5a8ecd-d2d1-497d-a30f-b7e352126c4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:16.830465 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0d5a8ecd-d2d1-497d-a30f-b7e352126c4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:16.830907 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0d5a8ecd-d2d1-497d-a30f-b7e352126c4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:16.831607 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0d5a8ecd-d2d1-497d-a30f-b7e352126c4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:16.832053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0d5a8ecd-d2d1-497d-a30f-b7e352126c4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:16.832469 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0d5a8ecd-d2d1-497d-a30f-b7e352126c4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:16.867232 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0d5a8ecd-d2d1-497d-a30f-b7e352126c4c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053157 Sep 01 17:42:16.873204 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 413/782] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:42:16 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 17:42:16.878133 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f1813902-9f67-4160-9cdf-f318efdf816f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:16.878626 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f1813902-9f67-4160-9cdf-f318efdf816f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:16.886329 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f1813902-9f67-4160-9cdf-f318efdf816f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:16.886951 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f1813902-9f67-4160-9cdf-f318efdf816f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:16.887680 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f1813902-9f67-4160-9cdf-f318efdf816f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:16.888569 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f1813902-9f67-4160-9cdf-f318efdf816f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:16.889656 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f1813902-9f67-4160-9cdf-f318efdf816f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:16.889656 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f1813902-9f67-4160-9cdf-f318efdf816f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:16.988693 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a9c92a24-95ef-4637-8b30-ec9011b9e69a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:16.998884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a9c92a24-95ef-4637-8b30-ec9011b9e69a tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1525 microversion: 2.1 time: 0.295541 Sep 01 17:42:17.006417 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 370/783] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:16 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1525 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:17.024322 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-f1813902-9f67-4160-9cdf-f318efdf816f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] HTTP exception thrown: Instance 14c4d577-d281-42b7-b448-d38b39a7ee39 is not attached to volume 7555b696-f5de-4888-8995-adbacd6351eb Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f1813902-9f67-4160-9cdf-f318efdf816f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Request method failure captured: Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: DELETE /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments/7555b696-f5de-4888-8995-adbacd6351eb HTTP/1.1 Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO5Fdb9l0pyvPMPsLAT7ery7S_Q4ghYllTxloNZ-t8iUXmpJS-d5sZ6IjXAyyduIDO-8MeqxxRM8r9_GP84fpRkoYzuMTsyEKrVHV5UsKCvhvvqLQZN6EPgkElUNFhD3NIHM-4wbg1_yQSan7jd8YG0MTjOYm3B5WehsC2b6cC13E_I Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 829a41984faf4b68a3f4b1e2fd2ded27 Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-TestMinimumBasicScenario-1664839035 Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:42:17.031008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:42:17.032968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/829a41984faf4b68a3f4b1e2fd2ded27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/829a41984faf4b68a3f4b1e2fd2ded27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_829a41984faf4b68a3f4b1e2fd2ded27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/829a41984faf4b68a3f4b1e2fd2ded27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:42:17.032968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-TestMinimumBasicScenario-1664839035 Sep 01 17:42:17.032968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 829a41984faf4b68a3f4b1e2fd2ded27 Sep 01 17:42:17.032968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1664839035 Sep 01 17:42:17.032968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-TestMinimumBasicScenario-1664839035-project Sep 01 17:42:17.032968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:42:17.032968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:42:17.032968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: c1bda5eb9abc4f6da200ea3f9500fbfa Sep 01 17:42:17.032968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-TestMinimumBasicScenario-1664839035-project Sep 01 17:42:17.032968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:42:17.032968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 14c4d577-d281-42b7-b448-d38b39a7ee39 is not attached to volume 7555b696-f5de-4888-8995-adbacd6351eb Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'server_id': '14c4d577-d281-42b7-b448-d38b39a7ee39', 'id': '7555b696-f5de-4888-8995-adbacd6351eb'} Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7555b696-f5de-4888-8995-adbacd6351eb. Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:42:17.033964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14c4d577-d281-42b7-b448-d38b39a7ee39 is not attached to volume 7555b696-f5de-4888-8995-adbacd6351eb Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14c4d577-d281-42b7-b448-d38b39a7ee39 is not attached to volume 7555b696-f5de-4888-8995-adbacd6351eb Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:17.035800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f1813902-9f67-4160-9cdf-f318efdf816f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Returning 404 to user: Instance 14c4d577-d281-42b7-b448-d38b39a7ee39 is not attached to volume 7555b696-f5de-4888-8995-adbacd6351eb {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:42:17.036981 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f1813902-9f67-4160-9cdf-f318efdf816f tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "DELETE /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments/7555b696-f5de-4888-8995-adbacd6351eb" status: 404 len: 154 microversion: 2.1 time: 0.158525 Sep 01 17:42:17.037133 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 414/784] 10.222.0.100 () {58 vars in 1421 bytes} [Thu Sep 1 17:42:16 2022] DELETE /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39/os-volume_attachments/7555b696-f5de-4888-8995-adbacd6351eb => generated 154 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:42:17.055218 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-e55f4e62-2eb4-4c3b-b050-4a78fd4264d2 req-716ab249-ee54-4667-b678-b16891e5ac44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f637e8e-d6ed-4516-b57d-48174aa65926", "name": "network-vif-deleted", "tag": "87b4da6d-8b68-433c-ae8f-43c4c9fda0c1"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:17.065418 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-e55f4e62-2eb4-4c3b-b050-4a78fd4264d2 req-716ab249-ee54-4667-b678-b16891e5ac44 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:17.066049 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-e55f4e62-2eb4-4c3b-b050-4a78fd4264d2 req-716ab249-ee54-4667-b678-b16891e5ac44 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:17.066331 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-e55f4e62-2eb4-4c3b-b050-4a78fd4264d2 req-716ab249-ee54-4667-b678-b16891e5ac44 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:17.079495 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-e55f4e62-2eb4-4c3b-b050-4a78fd4264d2 req-716ab249-ee54-4667-b678-b16891e5ac44 service nova] Creating event network-vif-deleted:87b4da6d-8b68-433c-ae8f-43c4c9fda0c1 for instance 0f637e8e-d6ed-4516-b57d-48174aa65926 on hv-cinder-83976 Sep 01 17:42:17.085645 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-e55f4e62-2eb4-4c3b-b050-4a78fd4264d2 req-716ab249-ee54-4667-b678-b16891e5ac44 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034756 Sep 01 17:42:17.086663 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 371/785] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:17.345789 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-71a84180-fcea-46be-9108-59809dfb086a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:17.346413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-71a84180-fcea-46be-9108-59809dfb086a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:17.355643 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-71a84180-fcea-46be-9108-59809dfb086a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:17.356437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-71a84180-fcea-46be-9108-59809dfb086a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:17.357034 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-71a84180-fcea-46be-9108-59809dfb086a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:17.357952 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-71a84180-fcea-46be-9108-59809dfb086a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:17.358574 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-71a84180-fcea-46be-9108-59809dfb086a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:17.358995 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-71a84180-fcea-46be-9108-59809dfb086a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:17.516978 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-71a84180-fcea-46be-9108-59809dfb086a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:17.525994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-71a84180-fcea-46be-9108-59809dfb086a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1371 microversion: 2.1 time: 0.183952 Sep 01 17:42:17.526588 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 415/786] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:17 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:17.637710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-7bc1d31c-532a-46f1-8865-921796904d1d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:17.638234 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-7bc1d31c-532a-46f1-8865-921796904d1d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:17.644425 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7bc1d31c-532a-46f1-8865-921796904d1d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:17.644906 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7bc1d31c-532a-46f1-8865-921796904d1d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:17.645913 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7bc1d31c-532a-46f1-8865-921796904d1d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:17.646700 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7bc1d31c-532a-46f1-8865-921796904d1d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:17.647157 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7bc1d31c-532a-46f1-8865-921796904d1d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:17.647575 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7bc1d31c-532a-46f1-8865-921796904d1d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:17.808626 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7bc1d31c-532a-46f1-8865-921796904d1d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:17.816941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-7bc1d31c-532a-46f1-8865-921796904d1d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.183980 Sep 01 17:42:17.817498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 372/787] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:17 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:18.020622 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:18.021389 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:18.027854 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:18.028347 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:18.028794 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:18.029505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:18.029994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:18.030423 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:18.065135 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:18.065756 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:18.066207 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:18.067100 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lazy-loading 'fault' on Instance uuid 0f637e8e-d6ed-4516-b57d-48174aa65926 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:42:18.127919 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:18.136632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7a0cb0d1-1aec-4aeb-9d1a-c701c56f2027 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1315 microversion: 2.1 time: 0.120502 Sep 01 17:42:18.137219 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 416/788] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:18 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1315 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:18.179368 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-47ea239b-6903-41f0-8335-41c4d41efc3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:18.179943 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-47ea239b-6903-41f0-8335-41c4d41efc3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:18.186228 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-47ea239b-6903-41f0-8335-41c4d41efc3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:18.186705 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-47ea239b-6903-41f0-8335-41c4d41efc3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:18.187138 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-47ea239b-6903-41f0-8335-41c4d41efc3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:18.187826 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-47ea239b-6903-41f0-8335-41c4d41efc3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:18.188321 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-47ea239b-6903-41f0-8335-41c4d41efc3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:18.188745 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-47ea239b-6903-41f0-8335-41c4d41efc3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:18.214817 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-47ea239b-6903-41f0-8335-41c4d41efc3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Going to try to terminate instance {{(pid=127232) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:42:18.293217 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-47ea239b-6903-41f0-8335-41c4d41efc3c tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "DELETE /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 204 len: 0 microversion: 2.1 time: 0.117519 Sep 01 17:42:18.293840 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 373/789] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:42:18 2022] DELETE /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:42:18.302756 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-919ee7ee-b072-42f7-bd78-0fca7e019ea6 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:18.303402 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-919ee7ee-b072-42f7-bd78-0fca7e019ea6 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:18.309400 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-919ee7ee-b072-42f7-bd78-0fca7e019ea6 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:18.309929 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-919ee7ee-b072-42f7-bd78-0fca7e019ea6 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:18.310368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-919ee7ee-b072-42f7-bd78-0fca7e019ea6 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:18.311068 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-919ee7ee-b072-42f7-bd78-0fca7e019ea6 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:18.311532 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-919ee7ee-b072-42f7-bd78-0fca7e019ea6 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:18.311955 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-919ee7ee-b072-42f7-bd78-0fca7e019ea6 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:18.451182 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-919ee7ee-b072-42f7-bd78-0fca7e019ea6 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:18.459682 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-919ee7ee-b072-42f7-bd78-0fca7e019ea6 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1558 microversion: 2.1 time: 0.161266 Sep 01 17:42:18.460262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 417/790] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:18 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:18.548977 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cb2b6268-a6bb-4e0b-9009-33b7e7e45cfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:18.549721 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-cb2b6268-a6bb-4e0b-9009-33b7e7e45cfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:18.568335 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cb2b6268-a6bb-4e0b-9009-33b7e7e45cfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:18.568850 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cb2b6268-a6bb-4e0b-9009-33b7e7e45cfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:18.569307 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cb2b6268-a6bb-4e0b-9009-33b7e7e45cfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:18.570090 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cb2b6268-a6bb-4e0b-9009-33b7e7e45cfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:18.570553 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cb2b6268-a6bb-4e0b-9009-33b7e7e45cfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:18.570973 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cb2b6268-a6bb-4e0b-9009-33b7e7e45cfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:18.720224 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-cb2b6268-a6bb-4e0b-9009-33b7e7e45cfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:18.728881 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-cb2b6268-a6bb-4e0b-9009-33b7e7e45cfc tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1562 microversion: 2.1 time: 0.184208 Sep 01 17:42:18.729462 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 374/791] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:18 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1562 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:18.749754 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a84ba309-4a9f-4a93-8ba1-cbe06ab866e5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:18.750247 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a84ba309-4a9f-4a93-8ba1-cbe06ab866e5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:18.756503 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a84ba309-4a9f-4a93-8ba1-cbe06ab866e5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:18.756986 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a84ba309-4a9f-4a93-8ba1-cbe06ab866e5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:18.757452 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a84ba309-4a9f-4a93-8ba1-cbe06ab866e5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:18.758184 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a84ba309-4a9f-4a93-8ba1-cbe06ab866e5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:18.758651 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a84ba309-4a9f-4a93-8ba1-cbe06ab866e5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:18.759066 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a84ba309-4a9f-4a93-8ba1-cbe06ab866e5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:18.839013 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-da1ee3cb-4b49-44ba-bc5f-efbae0769e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:18.839831 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-da1ee3cb-4b49-44ba-bc5f-efbae0769e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:18.841441 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a84ba309-4a9f-4a93-8ba1-cbe06ab866e5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095610 Sep 01 17:42:18.842080 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 418/792] 10.222.0.100 () {58 vars in 1280 bytes} [Thu Sep 1 17:42:18 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:18.846265 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da1ee3cb-4b49-44ba-bc5f-efbae0769e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:18.846835 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da1ee3cb-4b49-44ba-bc5f-efbae0769e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:18.847344 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da1ee3cb-4b49-44ba-bc5f-efbae0769e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:18.848125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da1ee3cb-4b49-44ba-bc5f-efbae0769e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:18.849322 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da1ee3cb-4b49-44ba-bc5f-efbae0769e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:18.850046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da1ee3cb-4b49-44ba-bc5f-efbae0769e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:19.133116 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-da1ee3cb-4b49-44ba-bc5f-efbae0769e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:19.141012 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-da1ee3cb-4b49-44ba-bc5f-efbae0769e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.305998 Sep 01 17:42:19.141621 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 375/793] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:18 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:19.159230 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:19.159933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:19.166952 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:19.167436 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:19.167904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:19.168650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:19.169101 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:19.169531 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:19.186767 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:19.206196 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:19.206652 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:19.207085 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:19.207532 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lazy-loading 'fault' on Instance uuid 0f637e8e-d6ed-4516-b57d-48174aa65926 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:42:19.292642 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:19.300495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-86928ef8-9921-4e02-befb-dde2e7a74787 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1315 microversion: 2.1 time: 0.146040 Sep 01 17:42:19.301087 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 419/794] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:19 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:19.482555 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-24c959b1-cb9a-4e9d-bebd-544a1d500e9d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:19.483161 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-24c959b1-cb9a-4e9d-bebd-544a1d500e9d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:19.490416 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24c959b1-cb9a-4e9d-bebd-544a1d500e9d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:19.490923 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24c959b1-cb9a-4e9d-bebd-544a1d500e9d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:19.491358 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24c959b1-cb9a-4e9d-bebd-544a1d500e9d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:19.492070 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24c959b1-cb9a-4e9d-bebd-544a1d500e9d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:19.492520 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24c959b1-cb9a-4e9d-bebd-544a1d500e9d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:19.492939 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24c959b1-cb9a-4e9d-bebd-544a1d500e9d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:19.828361 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-24c959b1-cb9a-4e9d-bebd-544a1d500e9d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:19.836374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-24c959b1-cb9a-4e9d-bebd-544a1d500e9d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1558 microversion: 2.1 time: 0.357903 Sep 01 17:42:19.836954 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 376/795] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:19 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1558 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:20.163956 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8738d85d-b63e-4701-b636-1ae4dcf32ff7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:20.164827 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8738d85d-b63e-4701-b636-1ae4dcf32ff7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:20.172152 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8738d85d-b63e-4701-b636-1ae4dcf32ff7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:20.172756 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8738d85d-b63e-4701-b636-1ae4dcf32ff7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:20.173154 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8738d85d-b63e-4701-b636-1ae4dcf32ff7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:20.173924 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8738d85d-b63e-4701-b636-1ae4dcf32ff7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:20.174386 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8738d85d-b63e-4701-b636-1ae4dcf32ff7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:20.174805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8738d85d-b63e-4701-b636-1ae4dcf32ff7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:20.303796 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-4ccfcbc1-2d2c-42bc-97dd-5866164f7151 req-003592be-fa79-47e7-bd3e-f4f61a022304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72608990-e16b-4544-9ce6-d340d1c8c577", "tag": "ec544ef7-b677-4f1d-8569-ad70326adfd8"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:20.315191 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:20.320394 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-4ccfcbc1-2d2c-42bc-97dd-5866164f7151 req-003592be-fa79-47e7-bd3e-f4f61a022304 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:20.321870 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-4ccfcbc1-2d2c-42bc-97dd-5866164f7151 req-003592be-fa79-47e7-bd3e-f4f61a022304 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:20.322872 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-4ccfcbc1-2d2c-42bc-97dd-5866164f7151 req-003592be-fa79-47e7-bd3e-f4f61a022304 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:20.350456 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-4ccfcbc1-2d2c-42bc-97dd-5866164f7151 req-003592be-fa79-47e7-bd3e-f4f61a022304 service nova] Creating event network-changed:ec544ef7-b677-4f1d-8569-ad70326adfd8 for instance 72608990-e16b-4544-9ce6-d340d1c8c577 on hv-cinder-83976 Sep 01 17:42:20.360748 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-4ccfcbc1-2d2c-42bc-97dd-5866164f7151 req-003592be-fa79-47e7-bd3e-f4f61a022304 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064896 Sep 01 17:42:20.362608 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 377/796] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:20.377933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8738d85d-b63e-4701-b636-1ae4dcf32ff7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:20.398825 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:20.400554 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:20.428488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8738d85d-b63e-4701-b636-1ae4dcf32ff7 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.268536 Sep 01 17:42:20.430412 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 420/797] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:20 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:20.436344 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:20.437472 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:20.438538 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:20.439994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:20.441059 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:20.443253 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:20.544747 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:20.545795 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:20.546591 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:20.547405 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lazy-loading 'fault' on Instance uuid 0f637e8e-d6ed-4516-b57d-48174aa65926 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:42:20.661439 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5647214c5b3f438eb3ef1ddc14153d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b01df46ff9744c2f830459547d7e4dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:20.671939 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-eb1adda1-e9e4-43a0-af55-5a3c2b786c73 tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 200 len: 1315 microversion: 2.1 time: 0.306819 Sep 01 17:42:20.685022 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 378/798] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:20 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:20.857107 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-bf58c0a2-d4c8-4d4e-9ba3-4e5a96e6b4f2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:20.857751 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-bf58c0a2-d4c8-4d4e-9ba3-4e5a96e6b4f2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:20.864892 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bf58c0a2-d4c8-4d4e-9ba3-4e5a96e6b4f2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:20.867577 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bf58c0a2-d4c8-4d4e-9ba3-4e5a96e6b4f2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:20.868234 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bf58c0a2-d4c8-4d4e-9ba3-4e5a96e6b4f2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:20.869131 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bf58c0a2-d4c8-4d4e-9ba3-4e5a96e6b4f2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:20.869779 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bf58c0a2-d4c8-4d4e-9ba3-4e5a96e6b4f2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:20.870361 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bf58c0a2-d4c8-4d4e-9ba3-4e5a96e6b4f2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:21.126772 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-bf58c0a2-d4c8-4d4e-9ba3-4e5a96e6b4f2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:21.136974 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-bf58c0a2-d4c8-4d4e-9ba3-4e5a96e6b4f2 tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1558 microversion: 2.1 time: 0.283554 Sep 01 17:42:21.137631 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 421/799] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:20 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1558 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:21.452176 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b3096902-9197-4c1c-97be-ab169cb61d93 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:21.452692 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b3096902-9197-4c1c-97be-ab169cb61d93 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:21.459687 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b3096902-9197-4c1c-97be-ab169cb61d93 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:21.460106 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b3096902-9197-4c1c-97be-ab169cb61d93 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:21.460538 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b3096902-9197-4c1c-97be-ab169cb61d93 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:21.461223 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b3096902-9197-4c1c-97be-ab169cb61d93 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:21.461700 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b3096902-9197-4c1c-97be-ab169cb61d93 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:21.462122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b3096902-9197-4c1c-97be-ab169cb61d93 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:21.609513 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b3096902-9197-4c1c-97be-ab169cb61d93 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:21.618145 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b3096902-9197-4c1c-97be-ab169cb61d93 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.170309 Sep 01 17:42:21.618733 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 379/800] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:21 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:21.692814 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-27294e7f-092f-4f4e-be9f-a98b0f888aaa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:21.693426 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-27294e7f-092f-4f4e-be9f-a98b0f888aaa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] [instance: 0f637e8e-d6ed-4516-b57d-48174aa65926] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:21.699885 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27294e7f-092f-4f4e-be9f-a98b0f888aaa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:21.700361 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27294e7f-092f-4f4e-be9f-a98b0f888aaa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:21.700792 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27294e7f-092f-4f4e-be9f-a98b0f888aaa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:21.701512 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27294e7f-092f-4f4e-be9f-a98b0f888aaa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:21.701992 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27294e7f-092f-4f4e-be9f-a98b0f888aaa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:21.702458 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-27294e7f-092f-4f4e-be9f-a98b0f888aaa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:21.716394 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-27294e7f-092f-4f4e-be9f-a98b0f888aaa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] HTTP exception thrown: Instance 0f637e8e-d6ed-4516-b57d-48174aa65926 could not be found. Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-27294e7f-092f-4f4e-be9f-a98b0f888aaa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Request method failure captured: Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 HTTP/1.1 Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2m8zyf1MdfI9Plug8mrFjRApjQ5c-8jQisg1PVk0tj5vFsUELO_1M1udUcyP_UxAfWvOWoJ8fDtqa8LTzrnjXG6uPV0irrnSvS-1H3XCvA0zw3nvSo7ARUEiib2-x1XXV_v7wdYFSh1m3JfZWwThjo3uq-lxNxGev-IFpfAVdzDqI Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: b01df46ff9744c2f830459547d7e4dd6 Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:42:21.717942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:42:21.719472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b01df46ff9744c2f830459547d7e4dd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:42:21.719472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:42:21.719472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: b01df46ff9744c2f830459547d7e4dd6 Sep 01 17:42:21.719472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1908064911 Sep 01 17:42:21.719472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-ServerRescueNegativeTestJSON-1908064911-project Sep 01 17:42:21.719472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:42:21.719472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:42:21.719472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: 5647214c5b3f438eb3ef1ddc14153d9e Sep 01 17:42:21.719472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1908064911-project Sep 01 17:42:21.719472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:42:21.719472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 0f637e8e-d6ed-4516-b57d-48174aa65926 could not be found. Sep 01 17:42:21.719472 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '0f637e8e-d6ed-4516-b57d-48174aa65926'} Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f637e8e-d6ed-4516-b57d-48174aa65926 could not be found. Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:42:21.720273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f637e8e-d6ed-4516-b57d-48174aa65926 could not be found. Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f637e8e-d6ed-4516-b57d-48174aa65926 could not be found. Sep 01 17:42:21.721463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:21.722564 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-27294e7f-092f-4f4e-be9f-a98b0f888aaa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] Returning 404 to user: Instance 0f637e8e-d6ed-4516-b57d-48174aa65926 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:42:21.722564 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-27294e7f-092f-4f4e-be9f-a98b0f888aaa tempest-ServerRescueNegativeTestJSON-1908064911 tempest-ServerRescueNegativeTestJSON-1908064911-project] 10.222.0.100 "GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926" status: 404 len: 111 microversion: 2.1 time: 0.030979 Sep 01 17:42:21.722564 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 422/801] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:21 2022] GET /compute/v2.1/servers/0f637e8e-d6ed-4516-b57d-48174aa65926 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:42:22.159680 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b43cf38e-cf28-4b05-851f-4b29b67bf76d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:22.161321 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b43cf38e-cf28-4b05-851f-4b29b67bf76d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:22.179926 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b43cf38e-cf28-4b05-851f-4b29b67bf76d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:22.180421 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b43cf38e-cf28-4b05-851f-4b29b67bf76d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:22.180887 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b43cf38e-cf28-4b05-851f-4b29b67bf76d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:22.181685 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b43cf38e-cf28-4b05-851f-4b29b67bf76d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:22.182366 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b43cf38e-cf28-4b05-851f-4b29b67bf76d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:22.182857 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b43cf38e-cf28-4b05-851f-4b29b67bf76d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:22.270217 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b43cf38e-cf28-4b05-851f-4b29b67bf76d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bda5eb9abc4f6da200ea3f9500fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829a41984faf4b68a3f4b1e2fd2ded27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:22.283122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b43cf38e-cf28-4b05-851f-4b29b67bf76d tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 200 len: 1347 microversion: 2.1 time: 0.127609 Sep 01 17:42:22.285212 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 380/802] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:22 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 1347 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:22.377244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-8cac2c2c-1f27-4ff8-90f2-80264f61784c req-be2c8e62-d24f-4665-9434-a6ac01530da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c4d577-d281-42b7-b448-d38b39a7ee39", "name": "network-vif-deleted", "tag": "43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:22.387480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-8cac2c2c-1f27-4ff8-90f2-80264f61784c req-be2c8e62-d24f-4665-9434-a6ac01530da0 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:22.387952 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-8cac2c2c-1f27-4ff8-90f2-80264f61784c req-be2c8e62-d24f-4665-9434-a6ac01530da0 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:22.388375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-8cac2c2c-1f27-4ff8-90f2-80264f61784c req-be2c8e62-d24f-4665-9434-a6ac01530da0 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:22.402718 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-8cac2c2c-1f27-4ff8-90f2-80264f61784c req-be2c8e62-d24f-4665-9434-a6ac01530da0 service nova] Creating event network-vif-deleted:43d44943-fac9-4ce0-9d01-e1b4b2b8ff2c for instance 14c4d577-d281-42b7-b448-d38b39a7ee39 on hv-cinder-83976 Sep 01 17:42:22.411568 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-8cac2c2c-1f27-4ff8-90f2-80264f61784c req-be2c8e62-d24f-4665-9434-a6ac01530da0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036838 Sep 01 17:42:22.414521 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 423/803] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:22.640354 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8ce625ea-9aca-4c54-8c17-626bcd473e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:22.640938 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8ce625ea-9aca-4c54-8c17-626bcd473e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:22.647102 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ce625ea-9aca-4c54-8c17-626bcd473e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:22.647592 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ce625ea-9aca-4c54-8c17-626bcd473e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:22.648022 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ce625ea-9aca-4c54-8c17-626bcd473e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:22.648712 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ce625ea-9aca-4c54-8c17-626bcd473e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:22.649166 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ce625ea-9aca-4c54-8c17-626bcd473e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:22.649640 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ce625ea-9aca-4c54-8c17-626bcd473e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:22.890505 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8ce625ea-9aca-4c54-8c17-626bcd473e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:22.904725 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8ce625ea-9aca-4c54-8c17-626bcd473e1f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.267814 Sep 01 17:42:22.906701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 381/804] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:22 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:23.308082 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-88fc6605-f336-4468-9828-8b67a416f2ec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:23.309947 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-88fc6605-f336-4468-9828-8b67a416f2ec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] [instance: 14c4d577-d281-42b7-b448-d38b39a7ee39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:23.316714 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-88fc6605-f336-4468-9828-8b67a416f2ec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:23.317994 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-88fc6605-f336-4468-9828-8b67a416f2ec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:23.318596 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-88fc6605-f336-4468-9828-8b67a416f2ec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:23.319294 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-88fc6605-f336-4468-9828-8b67a416f2ec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:23.319903 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-88fc6605-f336-4468-9828-8b67a416f2ec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:23.320330 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-88fc6605-f336-4468-9828-8b67a416f2ec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:23.334997 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-88fc6605-f336-4468-9828-8b67a416f2ec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] HTTP exception thrown: Instance 14c4d577-d281-42b7-b448-d38b39a7ee39 could not be found. Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-88fc6605-f336-4468-9828-8b67a416f2ec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Request method failure captured: Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 HTTP/1.1 Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO5Fdb9l0pyvPMPsLAT7ery7S_Q4ghYllTxloNZ-t8iUXmpJS-d5sZ6IjXAyyduIDO-8MeqxxRM8r9_GP84fpRkoYzuMTsyEKrVHV5UsKCvhvvqLQZN6EPgkElUNFhD3NIHM-4wbg1_yQSan7jd8YG0MTjOYm3B5WehsC2b6cC13E_I Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 829a41984faf4b68a3f4b1e2fd2ded27 Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-TestMinimumBasicScenario-1664839035 Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:42:23.337098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:42:23.338755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/829a41984faf4b68a3f4b1e2fd2ded27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/829a41984faf4b68a3f4b1e2fd2ded27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_829a41984faf4b68a3f4b1e2fd2ded27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/829a41984faf4b68a3f4b1e2fd2ded27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:42:23.338755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-TestMinimumBasicScenario-1664839035 Sep 01 17:42:23.338755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 829a41984faf4b68a3f4b1e2fd2ded27 Sep 01 17:42:23.338755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1664839035 Sep 01 17:42:23.338755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-TestMinimumBasicScenario-1664839035-project Sep 01 17:42:23.338755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:42:23.338755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:42:23.338755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: c1bda5eb9abc4f6da200ea3f9500fbfa Sep 01 17:42:23.338755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-TestMinimumBasicScenario-1664839035-project Sep 01 17:42:23.338755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:42:23.338755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 14c4d577-d281-42b7-b448-d38b39a7ee39 could not be found. Sep 01 17:42:23.338755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '14c4d577-d281-42b7-b448-d38b39a7ee39'} Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14c4d577-d281-42b7-b448-d38b39a7ee39 could not be found. Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:42:23.339866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14c4d577-d281-42b7-b448-d38b39a7ee39 could not be found. Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14c4d577-d281-42b7-b448-d38b39a7ee39 could not be found. Sep 01 17:42:23.341375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:42:23.342708 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-88fc6605-f336-4468-9828-8b67a416f2ec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Returning 404 to user: Instance 14c4d577-d281-42b7-b448-d38b39a7ee39 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:42:23.342708 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-88fc6605-f336-4468-9828-8b67a416f2ec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39" status: 404 len: 111 microversion: 2.1 time: 0.035047 Sep 01 17:42:23.347680 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b3aae832-e471-49a8-954f-1145230abdec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] Calling method '.version_select at 0x7f354a933af0>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:23.352076 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 424/805] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:23 2022] GET /compute/v2.1/servers/14c4d577-d281-42b7-b448-d38b39a7ee39 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:42:23.367595 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b3aae832-e471-49a8-954f-1145230abdec tempest-TestMinimumBasicScenario-1664839035 tempest-TestMinimumBasicScenario-1664839035-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1671587591" status: 202 len: 0 microversion: 2.1 time: 0.024071 Sep 01 17:42:23.368184 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 382/806] 10.222.0.100 () {58 vars in 1277 bytes} [Thu Sep 1 17:42:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1671587591 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:42:23.932040 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e76298e7-adb0-4032-b4ce-4f65a487db90 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:23.932759 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e76298e7-adb0-4032-b4ce-4f65a487db90 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:23.939380 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e76298e7-adb0-4032-b4ce-4f65a487db90 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:23.939870 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e76298e7-adb0-4032-b4ce-4f65a487db90 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:23.940310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e76298e7-adb0-4032-b4ce-4f65a487db90 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:23.941064 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e76298e7-adb0-4032-b4ce-4f65a487db90 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:23.942705 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e76298e7-adb0-4032-b4ce-4f65a487db90 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:23.943312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e76298e7-adb0-4032-b4ce-4f65a487db90 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:24.213806 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e76298e7-adb0-4032-b4ce-4f65a487db90 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:24.224861 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e76298e7-adb0-4032-b4ce-4f65a487db90 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1509 microversion: 2.1 time: 0.299504 Sep 01 17:42:24.228522 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 425/807] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:23 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1509 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:24.249240 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-517a07a0-475c-4508-b247-3323f3728d64 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:24.257010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-517a07a0-475c-4508-b247-3323f3728d64 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:24.265145 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-517a07a0-475c-4508-b247-3323f3728d64 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:24.266122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-517a07a0-475c-4508-b247-3323f3728d64 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:24.266833 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-517a07a0-475c-4508-b247-3323f3728d64 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:24.267552 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-517a07a0-475c-4508-b247-3323f3728d64 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:24.268160 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-517a07a0-475c-4508-b247-3323f3728d64 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:24.268587 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-517a07a0-475c-4508-b247-3323f3728d64 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:24.311821 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-517a07a0-475c-4508-b247-3323f3728d64 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127232) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 17:42:24.370176 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:24.406387 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-517a07a0-475c-4508-b247-3323f3728d64 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "POST /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0/action" status: 202 len: 0 microversion: 2.1 time: 0.161379 Sep 01 17:42:24.407631 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 383/808] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:42:24 2022] POST /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:42:24.417545 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-18a09467-b25b-47f9-a6ce-9f262b42ec32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:24.418196 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-18a09467-b25b-47f9-a6ce-9f262b42ec32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:24.433313 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18a09467-b25b-47f9-a6ce-9f262b42ec32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:24.433975 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18a09467-b25b-47f9-a6ce-9f262b42ec32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:24.434483 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18a09467-b25b-47f9-a6ce-9f262b42ec32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:24.435280 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18a09467-b25b-47f9-a6ce-9f262b42ec32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:24.438267 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18a09467-b25b-47f9-a6ce-9f262b42ec32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:24.438789 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-18a09467-b25b-47f9-a6ce-9f262b42ec32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:24.749729 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-18a09467-b25b-47f9-a6ce-9f262b42ec32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:24.760019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-18a09467-b25b-47f9-a6ce-9f262b42ec32 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1517 microversion: 2.1 time: 0.347746 Sep 01 17:42:24.767306 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 426/809] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:24 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1517 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:25.786560 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-619ac3e3-6792-404a-a87b-54e72c97f631 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:25.787862 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-619ac3e3-6792-404a-a87b-54e72c97f631 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:25.798046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-619ac3e3-6792-404a-a87b-54e72c97f631 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:25.798808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-619ac3e3-6792-404a-a87b-54e72c97f631 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:25.799418 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-619ac3e3-6792-404a-a87b-54e72c97f631 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:25.800371 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-619ac3e3-6792-404a-a87b-54e72c97f631 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:25.801085 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-619ac3e3-6792-404a-a87b-54e72c97f631 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:25.802804 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-619ac3e3-6792-404a-a87b-54e72c97f631 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:26.011537 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-619ac3e3-6792-404a-a87b-54e72c97f631 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:26.024628 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-619ac3e3-6792-404a-a87b-54e72c97f631 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1519 microversion: 2.1 time: 0.242578 Sep 01 17:42:26.043131 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 384/810] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:25 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1519 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:27.030489 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-c50f13ce-930a-4eed-98d1-4565e986a039 req-8a6c1843-aca1-4b57-89ca-e8408100d5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14547422-6c4f-4c71-8cf7-eaa09e5f52b0", "name": "network-vif-unplugged", "status": "completed", "tag": "a58ebdf5-88c8-48f6-b574-774858b2603f"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:27.047198 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-c50f13ce-930a-4eed-98d1-4565e986a039 req-8a6c1843-aca1-4b57-89ca-e8408100d5ae service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:27.049793 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-c50f13ce-930a-4eed-98d1-4565e986a039 req-8a6c1843-aca1-4b57-89ca-e8408100d5ae service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:27.050474 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-c50f13ce-930a-4eed-98d1-4565e986a039 req-8a6c1843-aca1-4b57-89ca-e8408100d5ae service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:27.051592 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-65a84edc-e722-4869-98cf-4925466d4efc tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:27.052299 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-65a84edc-e722-4869-98cf-4925466d4efc tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:27.063332 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-65a84edc-e722-4869-98cf-4925466d4efc tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:27.063914 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-65a84edc-e722-4869-98cf-4925466d4efc tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:27.065276 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-65a84edc-e722-4869-98cf-4925466d4efc tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:27.066442 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-65a84edc-e722-4869-98cf-4925466d4efc tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:27.067819 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-65a84edc-e722-4869-98cf-4925466d4efc tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:27.068948 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-65a84edc-e722-4869-98cf-4925466d4efc tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:27.092339 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-c50f13ce-930a-4eed-98d1-4565e986a039 req-8a6c1843-aca1-4b57-89ca-e8408100d5ae service nova] Creating event network-vif-unplugged:a58ebdf5-88c8-48f6-b574-774858b2603f for instance 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 on hv-cinder-83976 Sep 01 17:42:27.103171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-c50f13ce-930a-4eed-98d1-4565e986a039 req-8a6c1843-aca1-4b57-89ca-e8408100d5ae service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.211721 Sep 01 17:42:27.104479 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 427/811] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:27.455888 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-65a84edc-e722-4869-98cf-4925466d4efc tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:27.471172 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-65a84edc-e722-4869-98cf-4925466d4efc tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1575 microversion: 2.1 time: 0.418823 Sep 01 17:42:27.475012 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 385/812] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:27 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1575 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:28.495035 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-35739e92-2543-406d-8d74-3aeb1a05c480 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:28.496242 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-35739e92-2543-406d-8d74-3aeb1a05c480 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:28.507848 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35739e92-2543-406d-8d74-3aeb1a05c480 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:28.508622 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35739e92-2543-406d-8d74-3aeb1a05c480 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:28.509307 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35739e92-2543-406d-8d74-3aeb1a05c480 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:28.510803 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35739e92-2543-406d-8d74-3aeb1a05c480 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:28.511836 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35739e92-2543-406d-8d74-3aeb1a05c480 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:28.512368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35739e92-2543-406d-8d74-3aeb1a05c480 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:28.854510 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-35739e92-2543-406d-8d74-3aeb1a05c480 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:28.862680 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-35739e92-2543-406d-8d74-3aeb1a05c480 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1575 microversion: 2.1 time: 0.372113 Sep 01 17:42:28.863416 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 428/813] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:28 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1575 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:29.884831 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2af1f483-1bcd-4104-a289-28ba5a0d912f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:29.885645 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2af1f483-1bcd-4104-a289-28ba5a0d912f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:29.897307 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2af1f483-1bcd-4104-a289-28ba5a0d912f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:29.898160 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2af1f483-1bcd-4104-a289-28ba5a0d912f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:29.898810 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2af1f483-1bcd-4104-a289-28ba5a0d912f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:29.899675 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2af1f483-1bcd-4104-a289-28ba5a0d912f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:29.900325 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2af1f483-1bcd-4104-a289-28ba5a0d912f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:29.900919 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2af1f483-1bcd-4104-a289-28ba5a0d912f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:30.209048 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2af1f483-1bcd-4104-a289-28ba5a0d912f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:30.228760 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2af1f483-1bcd-4104-a289-28ba5a0d912f tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1575 microversion: 2.1 time: 0.347854 Sep 01 17:42:30.229615 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 386/814] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:29 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1575 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:31.256606 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5779572a-2ce7-44f4-9dbd-55e598dbeaeb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:31.256606 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5779572a-2ce7-44f4-9dbd-55e598dbeaeb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:31.276436 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5779572a-2ce7-44f4-9dbd-55e598dbeaeb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:31.277085 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5779572a-2ce7-44f4-9dbd-55e598dbeaeb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:31.277536 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5779572a-2ce7-44f4-9dbd-55e598dbeaeb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:31.278377 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5779572a-2ce7-44f4-9dbd-55e598dbeaeb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:31.278859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5779572a-2ce7-44f4-9dbd-55e598dbeaeb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:31.279298 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5779572a-2ce7-44f4-9dbd-55e598dbeaeb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:31.611504 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5779572a-2ce7-44f4-9dbd-55e598dbeaeb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:31.623140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5779572a-2ce7-44f4-9dbd-55e598dbeaeb tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1575 microversion: 2.1 time: 0.375679 Sep 01 17:42:31.624240 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 429/815] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:31 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1575 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:32.647409 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-dec6d7e3-5837-4c7c-b122-fb2745240aae tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:32.648866 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-dec6d7e3-5837-4c7c-b122-fb2745240aae tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:32.663643 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dec6d7e3-5837-4c7c-b122-fb2745240aae tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:32.666380 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dec6d7e3-5837-4c7c-b122-fb2745240aae tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:32.669963 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dec6d7e3-5837-4c7c-b122-fb2745240aae tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:32.670971 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dec6d7e3-5837-4c7c-b122-fb2745240aae tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:32.677599 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dec6d7e3-5837-4c7c-b122-fb2745240aae tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:32.678431 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dec6d7e3-5837-4c7c-b122-fb2745240aae tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:33.121035 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-dec6d7e3-5837-4c7c-b122-fb2745240aae tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:33.132338 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-dec6d7e3-5837-4c7c-b122-fb2745240aae tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1575 microversion: 2.1 time: 0.489939 Sep 01 17:42:33.133052 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 387/816] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:32 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1575 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:34.156091 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-680ca7ca-9eea-44e7-8c26-d6f1eb9e5996 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:34.157868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-680ca7ca-9eea-44e7-8c26-d6f1eb9e5996 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:34.170596 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-680ca7ca-9eea-44e7-8c26-d6f1eb9e5996 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:34.172716 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-680ca7ca-9eea-44e7-8c26-d6f1eb9e5996 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:34.174649 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-680ca7ca-9eea-44e7-8c26-d6f1eb9e5996 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:34.176307 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-680ca7ca-9eea-44e7-8c26-d6f1eb9e5996 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:34.177672 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-680ca7ca-9eea-44e7-8c26-d6f1eb9e5996 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:34.180776 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-680ca7ca-9eea-44e7-8c26-d6f1eb9e5996 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:34.573694 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-680ca7ca-9eea-44e7-8c26-d6f1eb9e5996 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:34.592156 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-680ca7ca-9eea-44e7-8c26-d6f1eb9e5996 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1575 microversion: 2.1 time: 0.438292 Sep 01 17:42:34.603450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 430/817] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:34 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1575 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:35.418069 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8cc10601-fa21-4df4-82dd-537d2ca46257 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Action: 'create', calling method: .version_select at 0x7f354a55f280>, body: {"keypair": {"name": "tempest-keypair-1150872533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUSYC9OoO6tJp7eS9kNvH5oxxXFRNH96+EIYX/gQbJlzf1cg0eo/KSfZJ2rhNs/PdmnS319ipzWwVYiKc5NPlegzkiVcamhW0+RJAdGH4wwSJczmYKkb0Urbtll8wDIYA=="}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:35.435796 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-8cc10601-fa21-4df4-82dd-537d2ca46257 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Getting quotas for project 8cdeb9d9f0eb4f1c805502bb30a99ebc. Resources: {'key_pairs'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:42:35.439914 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-8cc10601-fa21-4df4-82dd-537d2ca46257 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Getting quotas for user d8259269a28a401eb4ddbe90f128fe71 and project 8cdeb9d9f0eb4f1c805502bb30a99ebc. Resources: {'key_pairs'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:42:35.465512 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8cc10601-fa21-4df4-82dd-537d2ca46257 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.388163 Sep 01 17:42:35.466390 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 388/818] 10.222.0.100 () {60 vars in 1164 bytes} [Thu Sep 1 17:42:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:35.615972 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e3470aef-d981-4b6d-af88-c8e069f05665 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:35.617163 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e3470aef-d981-4b6d-af88-c8e069f05665 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:35.625031 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3470aef-d981-4b6d-af88-c8e069f05665 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:35.638501 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3470aef-d981-4b6d-af88-c8e069f05665 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:35.639149 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3470aef-d981-4b6d-af88-c8e069f05665 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:35.639946 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3470aef-d981-4b6d-af88-c8e069f05665 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:35.640434 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3470aef-d981-4b6d-af88-c8e069f05665 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:35.640869 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3470aef-d981-4b6d-af88-c8e069f05665 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:35.827466 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e3470aef-d981-4b6d-af88-c8e069f05665 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:35.836645 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e3470aef-d981-4b6d-af88-c8e069f05665 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1562 microversion: 2.1 time: 0.225581 Sep 01 17:42:35.837884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 431/819] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:35 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:36.946722 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-238430968", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec721b63-de0a-41b2-95e9-34f0275fa6c8"}], "security_groups": [{"name": "tempest-securitygroup--1275955628"}], "key_name": "tempest-keypair-1150872533", "user_data": "}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:37.059179 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.network.neutron [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] validate_networks() for [('ec721b63-de0a-41b2-95e9-34f0275fa6c8', None, None, None, None, None)] {{(pid=127232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:42:37.732142 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Flavor limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:42:37.732563 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Image limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:42:37.733034 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Flavor pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:42:37.733440 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Image pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:42:37.733873 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:42:37.743555 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:37.744046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:37.744486 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:37.745212 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:37.745752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:37.746119 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:37.763612 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Getting quotas for project 8cdeb9d9f0eb4f1c805502bb30a99ebc. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:42:37.767707 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Getting quotas for user d8259269a28a401eb4ddbe90f128fe71 and project 8cdeb9d9f0eb4f1c805502bb30a99ebc. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:42:37.778792 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Going to run 1 instances... {{(pid=127232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:42:37.781107 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:42:37.834398 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-3f189d3d-821f-457f-bcd4-1e9694de7c1e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.892998 Sep 01 17:42:37.840704 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 389/820] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:42:36 2022] POST /compute/v2.1/servers => generated 404 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:42:37.845865 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-77b37dd3-b063-44eb-b311-dc2c9841f2a0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:37.846514 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-77b37dd3-b063-44eb-b311-dc2c9841f2a0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:37.916549 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-77b37dd3-b063-44eb-b311-dc2c9841f2a0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:37.924300 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-77b37dd3-b063-44eb-b311-dc2c9841f2a0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1241 microversion: 2.1 time: 0.081402 Sep 01 17:42:37.925151 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 432/821] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:37 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:38.744767 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-8f7198b0-43ff-4522-9579-8a5fbec26eb9 req-0c26614e-ace5-4ddf-b975-1367990309bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14547422-6c4f-4c71-8cf7-eaa09e5f52b0", "name": "network-vif-plugged", "status": "completed", "tag": "a58ebdf5-88c8-48f6-b574-774858b2603f"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:38.758093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-8f7198b0-43ff-4522-9579-8a5fbec26eb9 req-0c26614e-ace5-4ddf-b975-1367990309bf service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:38.758583 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-8f7198b0-43ff-4522-9579-8a5fbec26eb9 req-0c26614e-ace5-4ddf-b975-1367990309bf service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:38.759022 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-8f7198b0-43ff-4522-9579-8a5fbec26eb9 req-0c26614e-ace5-4ddf-b975-1367990309bf service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:38.771152 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-8f7198b0-43ff-4522-9579-8a5fbec26eb9 req-0c26614e-ace5-4ddf-b975-1367990309bf service nova] Creating event network-vif-plugged:a58ebdf5-88c8-48f6-b574-774858b2603f for instance 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 on hv-cinder-83976 Sep 01 17:42:38.777824 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-8f7198b0-43ff-4522-9579-8a5fbec26eb9 req-0c26614e-ace5-4ddf-b975-1367990309bf service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039844 Sep 01 17:42:38.778429 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 390/822] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:42:38.944389 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4e0d2c1d-7588-49e0-8b04-b3fc05ef4fc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:38.945010 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4e0d2c1d-7588-49e0-8b04-b3fc05ef4fc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:38.947473 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:38.953145 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4e0d2c1d-7588-49e0-8b04-b3fc05ef4fc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:38.953658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4e0d2c1d-7588-49e0-8b04-b3fc05ef4fc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:38.954101 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4e0d2c1d-7588-49e0-8b04-b3fc05ef4fc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:38.954805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4e0d2c1d-7588-49e0-8b04-b3fc05ef4fc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:38.955263 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4e0d2c1d-7588-49e0-8b04-b3fc05ef4fc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:38.955689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4e0d2c1d-7588-49e0-8b04-b3fc05ef4fc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:39.027413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4e0d2c1d-7588-49e0-8b04-b3fc05ef4fc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:39.036273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4e0d2c1d-7588-49e0-8b04-b3fc05ef4fc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1293 microversion: 2.1 time: 0.095044 Sep 01 17:42:39.041801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 433/823] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:38 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:40.064764 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a80308c2-4472-40b8-8754-7c89e3985288 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:40.065567 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a80308c2-4472-40b8-8754-7c89e3985288 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:40.074007 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a80308c2-4472-40b8-8754-7c89e3985288 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:40.074613 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a80308c2-4472-40b8-8754-7c89e3985288 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:40.075271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a80308c2-4472-40b8-8754-7c89e3985288 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:40.076282 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a80308c2-4472-40b8-8754-7c89e3985288 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:40.076748 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a80308c2-4472-40b8-8754-7c89e3985288 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:40.077178 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a80308c2-4472-40b8-8754-7c89e3985288 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:40.248884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a80308c2-4472-40b8-8754-7c89e3985288 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:40.257666 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a80308c2-4472-40b8-8754-7c89e3985288 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1367 microversion: 2.1 time: 0.202766 Sep 01 17:42:40.258369 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 391/824] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:40 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:40.518945 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-1fc70c77-00b9-4c31-bebf-16f046b8fff0 req-a22f0bed-4a69-4a96-b3ff-4f419b00d5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad71e4c-acb3-4e98-a9a4-5cd212974512", "tag": "a6a8f7cf-5950-4c1e-81cb-c7f8526a0e9f"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:40.530995 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-1fc70c77-00b9-4c31-bebf-16f046b8fff0 req-a22f0bed-4a69-4a96-b3ff-4f419b00d5f4 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:40.531822 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-1fc70c77-00b9-4c31-bebf-16f046b8fff0 req-a22f0bed-4a69-4a96-b3ff-4f419b00d5f4 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:40.532425 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-1fc70c77-00b9-4c31-bebf-16f046b8fff0 req-a22f0bed-4a69-4a96-b3ff-4f419b00d5f4 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:40.545679 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-1fc70c77-00b9-4c31-bebf-16f046b8fff0 req-a22f0bed-4a69-4a96-b3ff-4f419b00d5f4 service nova] Creating event network-changed:a6a8f7cf-5950-4c1e-81cb-c7f8526a0e9f for instance bad71e4c-acb3-4e98-a9a4-5cd212974512 on hv-cinder-83976 Sep 01 17:42:40.554585 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-1fc70c77-00b9-4c31-bebf-16f046b8fff0 req-a22f0bed-4a69-4a96-b3ff-4f419b00d5f4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039552 Sep 01 17:42:40.555731 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 434/825] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:41.282030 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f2925267-1144-4008-9438-d25590f08dc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:41.282640 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f2925267-1144-4008-9438-d25590f08dc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:41.290317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f2925267-1144-4008-9438-d25590f08dc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:41.290800 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f2925267-1144-4008-9438-d25590f08dc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:41.291234 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f2925267-1144-4008-9438-d25590f08dc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:41.291928 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f2925267-1144-4008-9438-d25590f08dc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:41.292372 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f2925267-1144-4008-9438-d25590f08dc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:41.292792 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f2925267-1144-4008-9438-d25590f08dc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:41.438280 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f2925267-1144-4008-9438-d25590f08dc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:41.446593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f2925267-1144-4008-9438-d25590f08dc9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1367 microversion: 2.1 time: 0.168371 Sep 01 17:42:41.447166 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 392/826] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:41 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:42.469156 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-74798b67-6f46-45d9-811b-8c9c5fd21b3b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:42.469803 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-74798b67-6f46-45d9-811b-8c9c5fd21b3b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:42.476609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-74798b67-6f46-45d9-811b-8c9c5fd21b3b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:42.477154 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-74798b67-6f46-45d9-811b-8c9c5fd21b3b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:42.477613 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-74798b67-6f46-45d9-811b-8c9c5fd21b3b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:42.478326 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-74798b67-6f46-45d9-811b-8c9c5fd21b3b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:42.478775 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-74798b67-6f46-45d9-811b-8c9c5fd21b3b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:42.479227 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-74798b67-6f46-45d9-811b-8c9c5fd21b3b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:42.621910 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-74798b67-6f46-45d9-811b-8c9c5fd21b3b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:42.630889 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-74798b67-6f46-45d9-811b-8c9c5fd21b3b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1367 microversion: 2.1 time: 0.166579 Sep 01 17:42:42.631545 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 435/827] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:42 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:43.651113 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b73777ff-657a-4766-9e29-a40ef45cd6ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:43.651747 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b73777ff-657a-4766-9e29-a40ef45cd6ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:43.660763 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b73777ff-657a-4766-9e29-a40ef45cd6ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:43.661634 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b73777ff-657a-4766-9e29-a40ef45cd6ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:43.662216 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b73777ff-657a-4766-9e29-a40ef45cd6ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:43.663033 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b73777ff-657a-4766-9e29-a40ef45cd6ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:43.663676 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b73777ff-657a-4766-9e29-a40ef45cd6ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:43.664177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b73777ff-657a-4766-9e29-a40ef45cd6ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:43.803588 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b73777ff-657a-4766-9e29-a40ef45cd6ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:43.811589 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b73777ff-657a-4766-9e29-a40ef45cd6ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1367 microversion: 2.1 time: 0.164366 Sep 01 17:42:43.812176 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 393/828] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:43 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:44.833041 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e66886f7-84db-47ae-b9d7-cd388ea554c9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:44.833686 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e66886f7-84db-47ae-b9d7-cd388ea554c9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:44.840147 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e66886f7-84db-47ae-b9d7-cd388ea554c9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:44.840636 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e66886f7-84db-47ae-b9d7-cd388ea554c9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:44.841084 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e66886f7-84db-47ae-b9d7-cd388ea554c9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:44.841819 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e66886f7-84db-47ae-b9d7-cd388ea554c9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:44.842280 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e66886f7-84db-47ae-b9d7-cd388ea554c9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:44.842706 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e66886f7-84db-47ae-b9d7-cd388ea554c9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:44.980360 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e66886f7-84db-47ae-b9d7-cd388ea554c9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:44.988533 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e66886f7-84db-47ae-b9d7-cd388ea554c9 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1367 microversion: 2.1 time: 0.159944 Sep 01 17:42:44.989102 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 436/829] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:44 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:46.021465 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d19484e4-bd4c-40e0-a1dd-f79bfe9104fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:46.022044 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d19484e4-bd4c-40e0-a1dd-f79bfe9104fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:46.028541 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d19484e4-bd4c-40e0-a1dd-f79bfe9104fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:46.029027 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d19484e4-bd4c-40e0-a1dd-f79bfe9104fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:46.029464 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d19484e4-bd4c-40e0-a1dd-f79bfe9104fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:46.030192 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d19484e4-bd4c-40e0-a1dd-f79bfe9104fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:46.030650 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d19484e4-bd4c-40e0-a1dd-f79bfe9104fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:46.031073 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d19484e4-bd4c-40e0-a1dd-f79bfe9104fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:46.171890 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d19484e4-bd4c-40e0-a1dd-f79bfe9104fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:46.181301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d19484e4-bd4c-40e0-a1dd-f79bfe9104fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1367 microversion: 2.1 time: 0.163730 Sep 01 17:42:46.181926 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 394/830] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:46 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:46.653687 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-a32b7ee2-13bb-4b4f-a3e2-77e71a2c6bce req-6fd29149-823b-4e03-a23a-b27c9b97a904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad71e4c-acb3-4e98-a9a4-5cd212974512", "name": "network-vif-plugged", "status": "completed", "tag": "a6a8f7cf-5950-4c1e-81cb-c7f8526a0e9f"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:46.665419 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a32b7ee2-13bb-4b4f-a3e2-77e71a2c6bce req-6fd29149-823b-4e03-a23a-b27c9b97a904 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:46.666084 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a32b7ee2-13bb-4b4f-a3e2-77e71a2c6bce req-6fd29149-823b-4e03-a23a-b27c9b97a904 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:46.666521 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a32b7ee2-13bb-4b4f-a3e2-77e71a2c6bce req-6fd29149-823b-4e03-a23a-b27c9b97a904 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:46.678313 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-a32b7ee2-13bb-4b4f-a3e2-77e71a2c6bce req-6fd29149-823b-4e03-a23a-b27c9b97a904 service nova] Creating event network-vif-plugged:a6a8f7cf-5950-4c1e-81cb-c7f8526a0e9f for instance bad71e4c-acb3-4e98-a9a4-5cd212974512 on hv-cinder-83976 Sep 01 17:42:46.683223 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-a32b7ee2-13bb-4b4f-a3e2-77e71a2c6bce req-6fd29149-823b-4e03-a23a-b27c9b97a904 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033338 Sep 01 17:42:46.683818 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 437/831] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:47.202532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b75c4547-6b45-4352-b044-2a1d05241d3e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:47.203136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b75c4547-6b45-4352-b044-2a1d05241d3e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:47.210702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b75c4547-6b45-4352-b044-2a1d05241d3e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:47.211177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b75c4547-6b45-4352-b044-2a1d05241d3e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:47.211611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b75c4547-6b45-4352-b044-2a1d05241d3e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:47.212291 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b75c4547-6b45-4352-b044-2a1d05241d3e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:47.212739 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b75c4547-6b45-4352-b044-2a1d05241d3e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:47.213165 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b75c4547-6b45-4352-b044-2a1d05241d3e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:47.345283 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b75c4547-6b45-4352-b044-2a1d05241d3e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:47.353472 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b75c4547-6b45-4352-b044-2a1d05241d3e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1367 microversion: 2.1 time: 0.154806 Sep 01 17:42:47.354063 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 395/832] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:47 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:48.371792 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:48.376140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2a832cd5-53f3-45e7-ac95-2d82dbc9cbca tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:48.376841 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2a832cd5-53f3-45e7-ac95-2d82dbc9cbca tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:48.384158 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2a832cd5-53f3-45e7-ac95-2d82dbc9cbca tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:48.384644 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2a832cd5-53f3-45e7-ac95-2d82dbc9cbca tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:48.385076 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2a832cd5-53f3-45e7-ac95-2d82dbc9cbca tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:48.385867 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2a832cd5-53f3-45e7-ac95-2d82dbc9cbca tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:48.386325 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2a832cd5-53f3-45e7-ac95-2d82dbc9cbca tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:48.386756 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2a832cd5-53f3-45e7-ac95-2d82dbc9cbca tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:48.527756 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2a832cd5-53f3-45e7-ac95-2d82dbc9cbca tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:48.535953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2a832cd5-53f3-45e7-ac95-2d82dbc9cbca tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1367 microversion: 2.1 time: 0.165452 Sep 01 17:42:48.536592 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 438/833] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:48 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:48.553982 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2fc18c05-c470-4b47-b91e-4e42ab7a4c35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:48.554526 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2fc18c05-c470-4b47-b91e-4e42ab7a4c35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:48.556462 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:48.557112 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=10 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:48.564329 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2fc18c05-c470-4b47-b91e-4e42ab7a4c35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:48.564808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2fc18c05-c470-4b47-b91e-4e42ab7a4c35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:48.565246 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2fc18c05-c470-4b47-b91e-4e42ab7a4c35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:48.565978 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2fc18c05-c470-4b47-b91e-4e42ab7a4c35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:48.567773 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2fc18c05-c470-4b47-b91e-4e42ab7a4c35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:48.568200 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2fc18c05-c470-4b47-b91e-4e42ab7a4c35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:48.593940 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2fc18c05-c470-4b47-b91e-4e42ab7a4c35 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/ips" status: 200 len: 152 microversion: 2.20 time: 0.044512 Sep 01 17:42:48.594522 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 396/834] 10.222.0.100 () {60 vars in 1294 bytes} [Thu Sep 1 17:42:48 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:42:49.557228 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-55da3584-72ab-4755-b27d-392768b2df1b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:49.557781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-55da3584-72ab-4755-b27d-392768b2df1b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:49.564314 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-55da3584-72ab-4755-b27d-392768b2df1b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:49.564802 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-55da3584-72ab-4755-b27d-392768b2df1b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:49.565243 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-55da3584-72ab-4755-b27d-392768b2df1b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:49.565982 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-55da3584-72ab-4755-b27d-392768b2df1b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:49.567094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-55da3584-72ab-4755-b27d-392768b2df1b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:49.567529 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-55da3584-72ab-4755-b27d-392768b2df1b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:49.570149 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=90 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:49.709291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-55da3584-72ab-4755-b27d-392768b2df1b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:49.717110 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-55da3584-72ab-4755-b27d-392768b2df1b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1552 microversion: 2.1 time: 0.163847 Sep 01 17:42:49.717774 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 439/835] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:49 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:49.737354 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-099ed326-d414-4cdc-83c2-9510ed097f8f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:49.737905 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-099ed326-d414-4cdc-83c2-9510ed097f8f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:49.744862 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-099ed326-d414-4cdc-83c2-9510ed097f8f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:49.745341 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-099ed326-d414-4cdc-83c2-9510ed097f8f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:49.745798 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-099ed326-d414-4cdc-83c2-9510ed097f8f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:49.746480 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-099ed326-d414-4cdc-83c2-9510ed097f8f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:49.746929 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-099ed326-d414-4cdc-83c2-9510ed097f8f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:49.747346 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-099ed326-d414-4cdc-83c2-9510ed097f8f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:49.831559 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-099ed326-d414-4cdc-83c2-9510ed097f8f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097821 Sep 01 17:42:49.832630 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 397/836] 10.222.0.100 () {58 vars in 1280 bytes} [Thu Sep 1 17:42:49 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:51.041191 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-fb947ccb-f9ea-4983-a498-750f3667bfd6 req-08e3fbeb-b50a-4761-9d0f-7713da3eba3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad71e4c-acb3-4e98-a9a4-5cd212974512", "tag": "a6a8f7cf-5950-4c1e-81cb-c7f8526a0e9f"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:51.051465 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-fb947ccb-f9ea-4983-a498-750f3667bfd6 req-08e3fbeb-b50a-4761-9d0f-7713da3eba3c service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:51.051937 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-fb947ccb-f9ea-4983-a498-750f3667bfd6 req-08e3fbeb-b50a-4761-9d0f-7713da3eba3c service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:51.052365 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-fb947ccb-f9ea-4983-a498-750f3667bfd6 req-08e3fbeb-b50a-4761-9d0f-7713da3eba3c service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:51.063779 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-fb947ccb-f9ea-4983-a498-750f3667bfd6 req-08e3fbeb-b50a-4761-9d0f-7713da3eba3c service nova] Creating event network-changed:a6a8f7cf-5950-4c1e-81cb-c7f8526a0e9f for instance bad71e4c-acb3-4e98-a9a4-5cd212974512 on hv-cinder-83976 Sep 01 17:42:51.069713 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-fb947ccb-f9ea-4983-a498-750f3667bfd6 req-08e3fbeb-b50a-4761-9d0f-7713da3eba3c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032340 Sep 01 17:42:51.071144 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 440/837] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:51.462310 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-febc3777-9443-427c-bf26-3d6d58ff037f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:51.463084 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-febc3777-9443-427c-bf26-3d6d58ff037f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:51.464883 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:51.470709 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-febc3777-9443-427c-bf26-3d6d58ff037f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:51.471211 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-febc3777-9443-427c-bf26-3d6d58ff037f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:51.471657 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-febc3777-9443-427c-bf26-3d6d58ff037f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:51.472481 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-febc3777-9443-427c-bf26-3d6d58ff037f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:51.473181 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-febc3777-9443-427c-bf26-3d6d58ff037f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:51.473648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-febc3777-9443-427c-bf26-3d6d58ff037f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:51.501502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-febc3777-9443-427c-bf26-3d6d58ff037f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lazy-loading 'flavor' on Instance uuid 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:42:51.708654 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-febc3777-9443-427c-bf26-3d6d58ff037f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "POST /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/action" status: 202 len: 0 microversion: 2.20 time: 0.250915 Sep 01 17:42:51.709384 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 398/838] 10.222.0.100 () {62 vars in 1324 bytes} [Thu Sep 1 17:42:51 2022] POST /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:42:51.718427 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-094da2ae-6ef2-4fa8-a90a-50fdbaa9dacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:51.719117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-094da2ae-6ef2-4fa8-a90a-50fdbaa9dacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:51.726768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-094da2ae-6ef2-4fa8-a90a-50fdbaa9dacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:51.727508 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-094da2ae-6ef2-4fa8-a90a-50fdbaa9dacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:51.727955 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-094da2ae-6ef2-4fa8-a90a-50fdbaa9dacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:51.728790 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-094da2ae-6ef2-4fa8-a90a-50fdbaa9dacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:51.729294 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-094da2ae-6ef2-4fa8-a90a-50fdbaa9dacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:51.729742 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-094da2ae-6ef2-4fa8-a90a-50fdbaa9dacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:51.870138 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-094da2ae-6ef2-4fa8-a90a-50fdbaa9dacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:51.878271 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-094da2ae-6ef2-4fa8-a90a-50fdbaa9dacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:51.880774 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-094da2ae-6ef2-4fa8-a90a-50fdbaa9dacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:51.882039 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-094da2ae-6ef2-4fa8-a90a-50fdbaa9dacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.168128 Sep 01 17:42:51.882542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 441/839] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:51 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:42:52.907688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-666aa1f6-8f4e-4c84-a64f-e85245b0d377 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:52.908294 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-666aa1f6-8f4e-4c84-a64f-e85245b0d377 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:52.915620 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-666aa1f6-8f4e-4c84-a64f-e85245b0d377 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:52.916093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-666aa1f6-8f4e-4c84-a64f-e85245b0d377 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:52.916523 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-666aa1f6-8f4e-4c84-a64f-e85245b0d377 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:52.917201 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-666aa1f6-8f4e-4c84-a64f-e85245b0d377 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:52.917671 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-666aa1f6-8f4e-4c84-a64f-e85245b0d377 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:52.918094 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-666aa1f6-8f4e-4c84-a64f-e85245b0d377 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:53.050987 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-666aa1f6-8f4e-4c84-a64f-e85245b0d377 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:53.059935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-666aa1f6-8f4e-4c84-a64f-e85245b0d377 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:53.061465 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-666aa1f6-8f4e-4c84-a64f-e85245b0d377 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:53.062656 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-666aa1f6-8f4e-4c84-a64f-e85245b0d377 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.159791 Sep 01 17:42:53.063208 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 399/840] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:52 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:54.086748 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-04fd3947-5a44-4717-90c8-e341bb34d3a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:54.087366 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-04fd3947-5a44-4717-90c8-e341bb34d3a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:54.094601 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-04fd3947-5a44-4717-90c8-e341bb34d3a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:54.095087 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-04fd3947-5a44-4717-90c8-e341bb34d3a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:54.095551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-04fd3947-5a44-4717-90c8-e341bb34d3a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:54.096258 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-04fd3947-5a44-4717-90c8-e341bb34d3a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:54.096732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-04fd3947-5a44-4717-90c8-e341bb34d3a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:54.097155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-04fd3947-5a44-4717-90c8-e341bb34d3a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:54.240653 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-04fd3947-5a44-4717-90c8-e341bb34d3a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:54.248937 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-04fd3947-5a44-4717-90c8-e341bb34d3a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:54.250481 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-04fd3947-5a44-4717-90c8-e341bb34d3a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:54.251683 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-04fd3947-5a44-4717-90c8-e341bb34d3a0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.168994 Sep 01 17:42:54.252244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 442/841] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:54 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:55.273849 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b771d8f7-4c00-43d9-9138-31b8a6b1973c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:55.274457 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b771d8f7-4c00-43d9-9138-31b8a6b1973c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:55.280862 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b771d8f7-4c00-43d9-9138-31b8a6b1973c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:55.281336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b771d8f7-4c00-43d9-9138-31b8a6b1973c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:55.281813 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b771d8f7-4c00-43d9-9138-31b8a6b1973c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:55.282490 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b771d8f7-4c00-43d9-9138-31b8a6b1973c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:55.282938 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b771d8f7-4c00-43d9-9138-31b8a6b1973c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:55.283355 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b771d8f7-4c00-43d9-9138-31b8a6b1973c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:55.414229 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b771d8f7-4c00-43d9-9138-31b8a6b1973c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:55.422635 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b771d8f7-4c00-43d9-9138-31b8a6b1973c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:55.424084 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b771d8f7-4c00-43d9-9138-31b8a6b1973c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:55.425276 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b771d8f7-4c00-43d9-9138-31b8a6b1973c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.155485 Sep 01 17:42:55.426569 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 400/842] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:55 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:56.449019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f257ea53-58b5-4faf-ad79-09948157cd5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:56.449650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f257ea53-58b5-4faf-ad79-09948157cd5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:56.456354 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f257ea53-58b5-4faf-ad79-09948157cd5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:56.457125 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f257ea53-58b5-4faf-ad79-09948157cd5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:56.457777 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f257ea53-58b5-4faf-ad79-09948157cd5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:56.458386 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f257ea53-58b5-4faf-ad79-09948157cd5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:56.458842 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f257ea53-58b5-4faf-ad79-09948157cd5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:56.459264 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f257ea53-58b5-4faf-ad79-09948157cd5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:56.598059 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f257ea53-58b5-4faf-ad79-09948157cd5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:56.606249 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f257ea53-58b5-4faf-ad79-09948157cd5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:56.607757 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f257ea53-58b5-4faf-ad79-09948157cd5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:56.608921 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f257ea53-58b5-4faf-ad79-09948157cd5c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.164004 Sep 01 17:42:56.609489 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 443/843] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:56 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:57.633020 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8a99ee84-c188-4f33-bea3-569f5789d73f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:57.633612 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8a99ee84-c188-4f33-bea3-569f5789d73f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:57.639950 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8a99ee84-c188-4f33-bea3-569f5789d73f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:57.640421 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8a99ee84-c188-4f33-bea3-569f5789d73f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:57.640849 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8a99ee84-c188-4f33-bea3-569f5789d73f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:57.641537 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8a99ee84-c188-4f33-bea3-569f5789d73f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:57.642022 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8a99ee84-c188-4f33-bea3-569f5789d73f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:57.642439 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8a99ee84-c188-4f33-bea3-569f5789d73f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:57.646061 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:57.779992 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8a99ee84-c188-4f33-bea3-569f5789d73f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:57.788791 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8a99ee84-c188-4f33-bea3-569f5789d73f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:57.790555 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8a99ee84-c188-4f33-bea3-569f5789d73f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:57.791735 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8a99ee84-c188-4f33-bea3-569f5789d73f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.163406 Sep 01 17:42:57.792289 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 401/844] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:57 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:58.815078 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b5bfd5b6-d050-4095-b3f6-ab29a035e3dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:58.815688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-b5bfd5b6-d050-4095-b3f6-ab29a035e3dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:58.823066 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b5bfd5b6-d050-4095-b3f6-ab29a035e3dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:58.823549 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b5bfd5b6-d050-4095-b3f6-ab29a035e3dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:58.823987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b5bfd5b6-d050-4095-b3f6-ab29a035e3dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:58.824690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b5bfd5b6-d050-4095-b3f6-ab29a035e3dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:58.825144 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b5bfd5b6-d050-4095-b3f6-ab29a035e3dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:58.825566 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b5bfd5b6-d050-4095-b3f6-ab29a035e3dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:58.962913 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b5bfd5b6-d050-4095-b3f6-ab29a035e3dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:58.971228 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b5bfd5b6-d050-4095-b3f6-ab29a035e3dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:58.973266 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b5bfd5b6-d050-4095-b3f6-ab29a035e3dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:58.974488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-b5bfd5b6-d050-4095-b3f6-ab29a035e3dd tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.163387 Sep 01 17:42:58.975075 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 444/845] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:58 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:59.998593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5c4ac0c8-d5c5-447c-a1fe-aa5218737d90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:59.999191 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5c4ac0c8-d5c5-447c-a1fe-aa5218737d90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:00.007049 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c4ac0c8-d5c5-447c-a1fe-aa5218737d90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:00.007528 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c4ac0c8-d5c5-447c-a1fe-aa5218737d90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:00.007957 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c4ac0c8-d5c5-447c-a1fe-aa5218737d90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:00.008650 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c4ac0c8-d5c5-447c-a1fe-aa5218737d90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:00.009094 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c4ac0c8-d5c5-447c-a1fe-aa5218737d90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:00.009663 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5c4ac0c8-d5c5-447c-a1fe-aa5218737d90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:00.154245 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5c4ac0c8-d5c5-447c-a1fe-aa5218737d90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:00.163816 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5c4ac0c8-d5c5-447c-a1fe-aa5218737d90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:00.165524 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5c4ac0c8-d5c5-447c-a1fe-aa5218737d90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:00.166715 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5c4ac0c8-d5c5-447c-a1fe-aa5218737d90 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.172177 Sep 01 17:43:00.167272 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 402/846] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:59 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:01.192682 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3abf0ffd-5c02-4220-8d26-bd3b5392d966 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:01.193524 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3abf0ffd-5c02-4220-8d26-bd3b5392d966 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:01.199966 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3abf0ffd-5c02-4220-8d26-bd3b5392d966 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:01.200678 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3abf0ffd-5c02-4220-8d26-bd3b5392d966 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:01.201992 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3abf0ffd-5c02-4220-8d26-bd3b5392d966 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:01.201992 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3abf0ffd-5c02-4220-8d26-bd3b5392d966 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:01.202566 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3abf0ffd-5c02-4220-8d26-bd3b5392d966 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:01.202566 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3abf0ffd-5c02-4220-8d26-bd3b5392d966 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:01.345411 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3abf0ffd-5c02-4220-8d26-bd3b5392d966 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:01.355134 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3abf0ffd-5c02-4220-8d26-bd3b5392d966 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:01.356713 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3abf0ffd-5c02-4220-8d26-bd3b5392d966 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:01.357902 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3abf0ffd-5c02-4220-8d26-bd3b5392d966 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.171111 Sep 01 17:43:01.358469 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 445/847] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:01 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:02.385089 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-40ab2340-f71b-4148-8424-2dfde1021c9e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:02.385720 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-40ab2340-f71b-4148-8424-2dfde1021c9e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:02.392759 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-40ab2340-f71b-4148-8424-2dfde1021c9e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:02.393278 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-40ab2340-f71b-4148-8424-2dfde1021c9e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:02.393879 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-40ab2340-f71b-4148-8424-2dfde1021c9e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:02.394941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-40ab2340-f71b-4148-8424-2dfde1021c9e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:02.395400 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-40ab2340-f71b-4148-8424-2dfde1021c9e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:02.395826 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-40ab2340-f71b-4148-8424-2dfde1021c9e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:02.554207 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-40ab2340-f71b-4148-8424-2dfde1021c9e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:02.563367 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-40ab2340-f71b-4148-8424-2dfde1021c9e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:02.564824 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-40ab2340-f71b-4148-8424-2dfde1021c9e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:02.566788 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-40ab2340-f71b-4148-8424-2dfde1021c9e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.184832 Sep 01 17:43:02.567534 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 403/848] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:02 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:03.590007 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a1529a28-ead6-4ae5-a3d6-23addd986d33 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:03.590596 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a1529a28-ead6-4ae5-a3d6-23addd986d33 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:03.597151 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a1529a28-ead6-4ae5-a3d6-23addd986d33 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:03.597664 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a1529a28-ead6-4ae5-a3d6-23addd986d33 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:03.598103 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a1529a28-ead6-4ae5-a3d6-23addd986d33 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:03.598798 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a1529a28-ead6-4ae5-a3d6-23addd986d33 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:03.599246 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a1529a28-ead6-4ae5-a3d6-23addd986d33 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:03.599663 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a1529a28-ead6-4ae5-a3d6-23addd986d33 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:03.733380 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a1529a28-ead6-4ae5-a3d6-23addd986d33 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:03.742769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a1529a28-ead6-4ae5-a3d6-23addd986d33 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:03.744195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a1529a28-ead6-4ae5-a3d6-23addd986d33 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:03.745530 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a1529a28-ead6-4ae5-a3d6-23addd986d33 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.159284 Sep 01 17:43:03.745979 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 446/849] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:03 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:04.099746 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bebc0939-de7a-4eaa-bfc3-a4b9cd8498ed tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:04.100319 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bebc0939-de7a-4eaa-bfc3-a4b9cd8498ed tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:04.106737 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bebc0939-de7a-4eaa-bfc3-a4b9cd8498ed tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:04.107224 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bebc0939-de7a-4eaa-bfc3-a4b9cd8498ed tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:04.107664 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bebc0939-de7a-4eaa-bfc3-a4b9cd8498ed tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:04.108356 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bebc0939-de7a-4eaa-bfc3-a4b9cd8498ed tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:04.108808 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bebc0939-de7a-4eaa-bfc3-a4b9cd8498ed tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:04.109231 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bebc0939-de7a-4eaa-bfc3-a4b9cd8498ed tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:04.132330 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bebc0939-de7a-4eaa-bfc3-a4b9cd8498ed tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/ips" status: 200 len: 150 microversion: 2.1 time: 0.037071 Sep 01 17:43:04.132926 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 404/850] 10.222.0.100 () {58 vars in 1253 bytes} [Thu Sep 1 17:43:04 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:04.769012 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-856b62e9-2e7c-43a1-bce4-98af87343b4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:04.769744 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-856b62e9-2e7c-43a1-bce4-98af87343b4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:04.777067 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-856b62e9-2e7c-43a1-bce4-98af87343b4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:04.777557 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-856b62e9-2e7c-43a1-bce4-98af87343b4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:04.778129 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-856b62e9-2e7c-43a1-bce4-98af87343b4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:04.778887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-856b62e9-2e7c-43a1-bce4-98af87343b4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:04.779409 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-856b62e9-2e7c-43a1-bce4-98af87343b4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:04.779836 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-856b62e9-2e7c-43a1-bce4-98af87343b4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:04.920423 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-856b62e9-2e7c-43a1-bce4-98af87343b4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:04.929910 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-856b62e9-2e7c-43a1-bce4-98af87343b4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:04.931448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-856b62e9-2e7c-43a1-bce4-98af87343b4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:04.932689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-856b62e9-2e7c-43a1-bce4-98af87343b4d tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.167697 Sep 01 17:43:04.933255 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 447/851] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:04 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:05.490610 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f959353f-a392-47e4-817d-dd9c2eb2ca7a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f2e2a8f-bccf-4f25-8a18-83292605e6e0"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:05.492985 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f959353f-a392-47e4-817d-dd9c2eb2ca7a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:05.499678 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f959353f-a392-47e4-817d-dd9c2eb2ca7a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:05.500160 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f959353f-a392-47e4-817d-dd9c2eb2ca7a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:05.500602 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f959353f-a392-47e4-817d-dd9c2eb2ca7a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:05.501297 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f959353f-a392-47e4-817d-dd9c2eb2ca7a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:05.501800 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f959353f-a392-47e4-817d-dd9c2eb2ca7a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:05.502229 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f959353f-a392-47e4-817d-dd9c2eb2ca7a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:05.755759 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f959353f-a392-47e4-817d-dd9c2eb2ca7a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "POST /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269602 Sep 01 17:43:05.756402 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 405/852] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:43:05 2022] POST /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:05.956060 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-883a045a-da85-44c0-8cf3-9017b246a64a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:05.957255 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-883a045a-da85-44c0-8cf3-9017b246a64a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:05.963346 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-883a045a-da85-44c0-8cf3-9017b246a64a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:05.963825 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-883a045a-da85-44c0-8cf3-9017b246a64a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:05.964253 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-883a045a-da85-44c0-8cf3-9017b246a64a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:05.964939 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-883a045a-da85-44c0-8cf3-9017b246a64a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:05.965385 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-883a045a-da85-44c0-8cf3-9017b246a64a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:05.965836 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-883a045a-da85-44c0-8cf3-9017b246a64a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:06.103743 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-883a045a-da85-44c0-8cf3-9017b246a64a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:06.112571 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-883a045a-da85-44c0-8cf3-9017b246a64a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:06.114226 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-883a045a-da85-44c0-8cf3-9017b246a64a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:06.115421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-883a045a-da85-44c0-8cf3-9017b246a64a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.163348 Sep 01 17:43:06.115993 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 448/853] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:05 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:07.139888 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-76aeaf71-bb35-45ad-b02c-f75046e644c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:07.140640 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-76aeaf71-bb35-45ad-b02c-f75046e644c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:07.148032 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-76aeaf71-bb35-45ad-b02c-f75046e644c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:07.148508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-76aeaf71-bb35-45ad-b02c-f75046e644c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:07.149005 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-76aeaf71-bb35-45ad-b02c-f75046e644c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:07.149661 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-76aeaf71-bb35-45ad-b02c-f75046e644c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:07.150110 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-76aeaf71-bb35-45ad-b02c-f75046e644c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:07.150527 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-76aeaf71-bb35-45ad-b02c-f75046e644c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:07.291635 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-76aeaf71-bb35-45ad-b02c-f75046e644c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:07.300167 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-76aeaf71-bb35-45ad-b02c-f75046e644c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:07.302013 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-76aeaf71-bb35-45ad-b02c-f75046e644c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:07.303196 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-76aeaf71-bb35-45ad-b02c-f75046e644c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1748 microversion: 2.20 time: 0.168520 Sep 01 17:43:07.303765 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 406/854] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:07 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:08.328105 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c1717200-0c86-401e-b166-cc3a111a7da0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:08.328724 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c1717200-0c86-401e-b166-cc3a111a7da0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:08.335953 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c1717200-0c86-401e-b166-cc3a111a7da0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:08.336445 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c1717200-0c86-401e-b166-cc3a111a7da0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:08.336883 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c1717200-0c86-401e-b166-cc3a111a7da0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:08.337627 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c1717200-0c86-401e-b166-cc3a111a7da0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:08.338086 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c1717200-0c86-401e-b166-cc3a111a7da0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:08.338511 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c1717200-0c86-401e-b166-cc3a111a7da0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:08.480626 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c1717200-0c86-401e-b166-cc3a111a7da0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:08.489680 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c1717200-0c86-401e-b166-cc3a111a7da0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:08.491137 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c1717200-0c86-401e-b166-cc3a111a7da0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:08.492327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-c1717200-0c86-401e-b166-cc3a111a7da0 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1748 microversion: 2.20 time: 0.168490 Sep 01 17:43:08.492886 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 449/855] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:08 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:09.515784 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6fb8fd7e-be88-40c6-b4a3-1249c85f55e6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:09.516495 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6fb8fd7e-be88-40c6-b4a3-1249c85f55e6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:09.523400 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6fb8fd7e-be88-40c6-b4a3-1249c85f55e6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:09.523972 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6fb8fd7e-be88-40c6-b4a3-1249c85f55e6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:09.524476 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6fb8fd7e-be88-40c6-b4a3-1249c85f55e6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:09.525245 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6fb8fd7e-be88-40c6-b4a3-1249c85f55e6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:09.525811 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6fb8fd7e-be88-40c6-b4a3-1249c85f55e6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:09.526321 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6fb8fd7e-be88-40c6-b4a3-1249c85f55e6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:09.677519 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6fb8fd7e-be88-40c6-b4a3-1249c85f55e6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:09.686439 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6fb8fd7e-be88-40c6-b4a3-1249c85f55e6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:09.687998 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6fb8fd7e-be88-40c6-b4a3-1249c85f55e6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:09.689365 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6fb8fd7e-be88-40c6-b4a3-1249c85f55e6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1743 microversion: 2.20 time: 0.177490 Sep 01 17:43:09.689966 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 407/856] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:09 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:10.719236 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cb315e0b-d45f-4ee7-b77a-015a6353f731 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:10.720617 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cb315e0b-d45f-4ee7-b77a-015a6353f731 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:10.728344 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=34 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:10.729805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb315e0b-d45f-4ee7-b77a-015a6353f731 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:10.730708 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb315e0b-d45f-4ee7-b77a-015a6353f731 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:10.731150 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb315e0b-d45f-4ee7-b77a-015a6353f731 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:10.731974 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb315e0b-d45f-4ee7-b77a-015a6353f731 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:10.732318 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb315e0b-d45f-4ee7-b77a-015a6353f731 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:10.732745 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb315e0b-d45f-4ee7-b77a-015a6353f731 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:10.891759 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cb315e0b-d45f-4ee7-b77a-015a6353f731 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:10.901223 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cb315e0b-d45f-4ee7-b77a-015a6353f731 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:10.903309 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cb315e0b-d45f-4ee7-b77a-015a6353f731 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:10.904712 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cb315e0b-d45f-4ee7-b77a-015a6353f731 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1743 microversion: 2.20 time: 0.192473 Sep 01 17:43:10.905462 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 450/857] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:10 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1743 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:43:11.934779 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e0779371-e009-4f94-82d0-c9c97ca790dc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:11.935519 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e0779371-e009-4f94-82d0-c9c97ca790dc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:11.943185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e0779371-e009-4f94-82d0-c9c97ca790dc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:11.943977 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e0779371-e009-4f94-82d0-c9c97ca790dc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:11.944489 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e0779371-e009-4f94-82d0-c9c97ca790dc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:11.945422 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e0779371-e009-4f94-82d0-c9c97ca790dc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:11.945995 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e0779371-e009-4f94-82d0-c9c97ca790dc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:11.947267 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e0779371-e009-4f94-82d0-c9c97ca790dc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:12.098777 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e0779371-e009-4f94-82d0-c9c97ca790dc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:12.108778 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e0779371-e009-4f94-82d0-c9c97ca790dc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:12.111836 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e0779371-e009-4f94-82d0-c9c97ca790dc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:12.113817 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e0779371-e009-4f94-82d0-c9c97ca790dc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1743 microversion: 2.20 time: 0.183168 Sep 01 17:43:12.116468 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 408/858] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:11 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:12.753092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-1ae8ffa4-a16f-4fc0-b4bb-f3bd2f1e7c96 req-95c074fd-0ce8-4dc4-ab82-d3855a7858b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3623a32e-47b4-43dc-a80b-ca4254f4eaa5", "name": "network-vif-plugged", "status": "completed", "tag": "67cfe8a5-3543-438d-a85f-436e1ad2ec3b"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:12.777976 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-1ae8ffa4-a16f-4fc0-b4bb-f3bd2f1e7c96 req-95c074fd-0ce8-4dc4-ab82-d3855a7858b5 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:12.779830 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-1ae8ffa4-a16f-4fc0-b4bb-f3bd2f1e7c96 req-95c074fd-0ce8-4dc4-ab82-d3855a7858b5 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:12.780923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-1ae8ffa4-a16f-4fc0-b4bb-f3bd2f1e7c96 req-95c074fd-0ce8-4dc4-ab82-d3855a7858b5 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:12.796483 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-1ae8ffa4-a16f-4fc0-b4bb-f3bd2f1e7c96 req-95c074fd-0ce8-4dc4-ab82-d3855a7858b5 service nova] Creating event network-vif-plugged:67cfe8a5-3543-438d-a85f-436e1ad2ec3b for instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 on hv-cinder-83976 Sep 01 17:43:12.803580 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-1ae8ffa4-a16f-4fc0-b4bb-f3bd2f1e7c96 req-95c074fd-0ce8-4dc4-ab82-d3855a7858b5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057511 Sep 01 17:43:12.805332 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 451/859] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:13.146342 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b77fc363-708a-4607-ab69-bd264ad30aa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:13.146967 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b77fc363-708a-4607-ab69-bd264ad30aa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:13.154053 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b77fc363-708a-4607-ab69-bd264ad30aa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:13.154774 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b77fc363-708a-4607-ab69-bd264ad30aa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:13.155404 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b77fc363-708a-4607-ab69-bd264ad30aa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:13.156330 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b77fc363-708a-4607-ab69-bd264ad30aa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:13.156790 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b77fc363-708a-4607-ab69-bd264ad30aa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:13.157216 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b77fc363-708a-4607-ab69-bd264ad30aa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:13.337991 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b77fc363-708a-4607-ab69-bd264ad30aa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:13.341847 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b77fc363-708a-4607-ab69-bd264ad30aa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:13.343407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b77fc363-708a-4607-ab69-bd264ad30aa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:13.344761 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b77fc363-708a-4607-ab69-bd264ad30aa6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1743 microversion: 2.20 time: 0.205186 Sep 01 17:43:13.355590 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 409/860] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:13 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1743 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:13.423872 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-81e5099b-9d40-4ed1-85ac-73e9e3374718 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f2e2a8f-bccf-4f25-8a18-83292605e6e0"}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:13.426415 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-81e5099b-9d40-4ed1-85ac-73e9e3374718 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:13.434928 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-81e5099b-9d40-4ed1-85ac-73e9e3374718 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:13.435599 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-81e5099b-9d40-4ed1-85ac-73e9e3374718 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:13.436263 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-81e5099b-9d40-4ed1-85ac-73e9e3374718 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:13.436989 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-81e5099b-9d40-4ed1-85ac-73e9e3374718 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:13.437449 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-81e5099b-9d40-4ed1-85ac-73e9e3374718 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:13.437906 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-81e5099b-9d40-4ed1-85ac-73e9e3374718 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:13.550899 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-81e5099b-9d40-4ed1-85ac-73e9e3374718 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Invalid volume: volume 8f2e2a8f-bccf-4f25-8a18-83292605e6e0 is already attached to instances: 72608990-e16b-4544-9ce6-d340d1c8c577 Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-81e5099b-9d40-4ed1-85ac-73e9e3374718 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: POST /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/os-volume_attachments HTTP/1.1 Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 74 Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:43:13.553179 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:43:13.554914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:43:13.554914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:43:13.554914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:43:13.554914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:43:13.554914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:43:13.554914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:43:13.554914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:43:13.554914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:43:13.554914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:43:13.554914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Sep 01 17:43:13.554914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {"volumeAttachment": {"volumeId": "8f2e2a8f-bccf-4f25-8a18-83292605e6e0"}} Sep 01 17:43:13.554914 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Invalid volume: volume 8f2e2a8f-bccf-4f25-8a18-83292605e6e0 is already attached to instances: 72608990-e16b-4544-9ce6-d340d1c8c577 Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'server_id': '72608990-e16b-4544-9ce6-d340d1c8c577', 'body': {'volumeAttachment': {'volumeId': '8f2e2a8f-bccf-4f25-8a18-83292605e6e0'}}} Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8f2e2a8f-bccf-4f25-8a18-83292605e6e0 is already attached to instances: 72608990-e16b-4544-9ce6-d340d1c8c577 Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:43:13.555884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8f2e2a8f-bccf-4f25-8a18-83292605e6e0 is already attached to instances: 72608990-e16b-4544-9ce6-d340d1c8c577 Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:13.557437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:13.562631 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:13.562631 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:43:13.562631 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:43:13.562631 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8f2e2a8f-bccf-4f25-8a18-83292605e6e0 is already attached to instances: 72608990-e16b-4544-9ce6-d340d1c8c577 Sep 01 17:43:13.562631 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:43:13.562631 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-81e5099b-9d40-4ed1-85ac-73e9e3374718 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 400 to user: Invalid volume: volume 8f2e2a8f-bccf-4f25-8a18-83292605e6e0 is already attached to instances: 72608990-e16b-4544-9ce6-d340d1c8c577 {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:43:13.562631 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-81e5099b-9d40-4ed1-85ac-73e9e3374718 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "POST /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.141809 Sep 01 17:43:13.562631 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 452/861] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:43:13 2022] POST /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/os-volume_attachments => generated 174 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:43:13.654255 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-98d87046-88dd-4da7-be85-1c54f572e3ac tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:13.654953 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-98d87046-88dd-4da7-be85-1c54f572e3ac tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:13.663926 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-98d87046-88dd-4da7-be85-1c54f572e3ac tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:13.665300 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-98d87046-88dd-4da7-be85-1c54f572e3ac tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:13.666150 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-98d87046-88dd-4da7-be85-1c54f572e3ac tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:13.667406 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-98d87046-88dd-4da7-be85-1c54f572e3ac tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:13.668162 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-98d87046-88dd-4da7-be85-1c54f572e3ac tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:13.669509 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-98d87046-88dd-4da7-be85-1c54f572e3ac tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:13.787489 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-98d87046-88dd-4da7-be85-1c54f572e3ac tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lazy-loading 'services' on Instance uuid 72608990-e16b-4544-9ce6-d340d1c8c577 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:43:13.885979 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-98d87046-88dd-4da7-be85-1c54f572e3ac tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/os-volume_attachments/8f2e2a8f-bccf-4f25-8a18-83292605e6e0" status: 202 len: 0 microversion: 2.1 time: 0.235762 Sep 01 17:43:13.890628 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 410/862] 10.222.0.100 () {58 vars in 1421 bytes} [Thu Sep 1 17:43:13 2022] DELETE /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/os-volume_attachments/8f2e2a8f-bccf-4f25-8a18-83292605e6e0 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:43:13.904090 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7cf606e2-6027-4a61-a5b3-bae64cc7da06 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:13.907438 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7cf606e2-6027-4a61-a5b3-bae64cc7da06 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:13.919577 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7cf606e2-6027-4a61-a5b3-bae64cc7da06 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:13.920191 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7cf606e2-6027-4a61-a5b3-bae64cc7da06 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:13.920750 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7cf606e2-6027-4a61-a5b3-bae64cc7da06 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:13.921560 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7cf606e2-6027-4a61-a5b3-bae64cc7da06 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:13.922789 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7cf606e2-6027-4a61-a5b3-bae64cc7da06 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:13.923663 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7cf606e2-6027-4a61-a5b3-bae64cc7da06 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:13.961486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7cf606e2-6027-4a61-a5b3-bae64cc7da06 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069634 Sep 01 17:43:13.962516 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 453/863] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:43:13 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:43:14.375213 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-31858a61-9114-4ac1-8b17-5149627a7a44 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:14.378580 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-31858a61-9114-4ac1-8b17-5149627a7a44 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:14.390183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31858a61-9114-4ac1-8b17-5149627a7a44 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:14.391270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31858a61-9114-4ac1-8b17-5149627a7a44 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:14.391668 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31858a61-9114-4ac1-8b17-5149627a7a44 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:14.392615 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31858a61-9114-4ac1-8b17-5149627a7a44 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:14.394498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31858a61-9114-4ac1-8b17-5149627a7a44 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:14.395040 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-31858a61-9114-4ac1-8b17-5149627a7a44 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:14.574959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-31858a61-9114-4ac1-8b17-5149627a7a44 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:14.585669 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-31858a61-9114-4ac1-8b17-5149627a7a44 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:14.587303 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-31858a61-9114-4ac1-8b17-5149627a7a44 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:14.588920 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-31858a61-9114-4ac1-8b17-5149627a7a44 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1743 microversion: 2.20 time: 0.218717 Sep 01 17:43:14.590102 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 411/864] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:14 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1743 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:14.979749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-bd9e3cfb-1111-48b1-af8f-e379b804ad6a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:14.982051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-bd9e3cfb-1111-48b1-af8f-e379b804ad6a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:14.989797 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd9e3cfb-1111-48b1-af8f-e379b804ad6a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:14.990695 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd9e3cfb-1111-48b1-af8f-e379b804ad6a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:14.991483 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd9e3cfb-1111-48b1-af8f-e379b804ad6a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:14.992270 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd9e3cfb-1111-48b1-af8f-e379b804ad6a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:14.992794 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd9e3cfb-1111-48b1-af8f-e379b804ad6a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:14.993287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd9e3cfb-1111-48b1-af8f-e379b804ad6a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:15.026686 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-bd9e3cfb-1111-48b1-af8f-e379b804ad6a tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051030 Sep 01 17:43:15.027266 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 454/865] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:43:14 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:43:15.108739 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-39b360f0-7049-403f-83b5-0de7634c8695 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:15.109230 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-39b360f0-7049-403f-83b5-0de7634c8695 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:15.120180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39b360f0-7049-403f-83b5-0de7634c8695 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:15.120672 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39b360f0-7049-403f-83b5-0de7634c8695 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:15.121103 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39b360f0-7049-403f-83b5-0de7634c8695 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:15.121859 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39b360f0-7049-403f-83b5-0de7634c8695 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:15.122310 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39b360f0-7049-403f-83b5-0de7634c8695 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:15.122737 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39b360f0-7049-403f-83b5-0de7634c8695 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:15.161769 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-39b360f0-7049-403f-83b5-0de7634c8695 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Going to try to terminate instance {{(pid=127232) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:43:15.279732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-39b360f0-7049-403f-83b5-0de7634c8695 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 204 len: 0 microversion: 2.1 time: 0.174784 Sep 01 17:43:15.280949 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 412/866] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:43:15 2022] DELETE /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 17:43:15.291114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4fd4fd26-0c66-4518-8913-1cddfb45deab tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:15.291743 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4fd4fd26-0c66-4518-8913-1cddfb45deab tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:15.299209 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4fd4fd26-0c66-4518-8913-1cddfb45deab tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:15.299724 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4fd4fd26-0c66-4518-8913-1cddfb45deab tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:15.300254 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4fd4fd26-0c66-4518-8913-1cddfb45deab tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:15.301005 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4fd4fd26-0c66-4518-8913-1cddfb45deab tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:15.301473 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4fd4fd26-0c66-4518-8913-1cddfb45deab tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:15.303697 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4fd4fd26-0c66-4518-8913-1cddfb45deab tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:15.481518 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4fd4fd26-0c66-4518-8913-1cddfb45deab tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:15.492652 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4fd4fd26-0c66-4518-8913-1cddfb45deab tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1686 microversion: 2.1 time: 0.205773 Sep 01 17:43:15.493109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 455/867] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:15 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1686 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:15.618464 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-1667eea0-4d79-4381-883e-5beefa11756e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:15.619205 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-1667eea0-4d79-4381-883e-5beefa11756e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:15.626092 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1667eea0-4d79-4381-883e-5beefa11756e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:15.626963 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1667eea0-4d79-4381-883e-5beefa11756e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:15.627463 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1667eea0-4d79-4381-883e-5beefa11756e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:15.628274 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1667eea0-4d79-4381-883e-5beefa11756e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:15.628930 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1667eea0-4d79-4381-883e-5beefa11756e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:15.629358 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1667eea0-4d79-4381-883e-5beefa11756e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:15.808322 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1667eea0-4d79-4381-883e-5beefa11756e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:15.818323 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1667eea0-4d79-4381-883e-5beefa11756e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:15.819894 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1667eea0-4d79-4381-883e-5beefa11756e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:15.821198 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-1667eea0-4d79-4381-883e-5beefa11756e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1743 microversion: 2.20 time: 0.212526 Sep 01 17:43:15.832732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 413/868] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:15 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1743 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:16.526129 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5c32b9d4-8d18-4a4d-8898-91414fed32a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:16.527647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5c32b9d4-8d18-4a4d-8898-91414fed32a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:16.535614 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5c32b9d4-8d18-4a4d-8898-91414fed32a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:16.536437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5c32b9d4-8d18-4a4d-8898-91414fed32a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:16.537250 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5c32b9d4-8d18-4a4d-8898-91414fed32a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:16.538005 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5c32b9d4-8d18-4a4d-8898-91414fed32a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:16.538617 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5c32b9d4-8d18-4a4d-8898-91414fed32a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:16.539223 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5c32b9d4-8d18-4a4d-8898-91414fed32a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:16.728565 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-5c32b9d4-8d18-4a4d-8898-91414fed32a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:16.739746 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5c32b9d4-8d18-4a4d-8898-91414fed32a9 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1686 microversion: 2.1 time: 0.218248 Sep 01 17:43:16.740389 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 456/869] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:16 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1686 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:16.850016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-14bc8b08-cc21-4609-a27d-d10711b8c92f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:16.852129 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-14bc8b08-cc21-4609-a27d-d10711b8c92f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:16.861541 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14bc8b08-cc21-4609-a27d-d10711b8c92f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:16.862965 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14bc8b08-cc21-4609-a27d-d10711b8c92f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:16.863484 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14bc8b08-cc21-4609-a27d-d10711b8c92f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:16.864351 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14bc8b08-cc21-4609-a27d-d10711b8c92f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:16.865079 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14bc8b08-cc21-4609-a27d-d10711b8c92f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:16.865628 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14bc8b08-cc21-4609-a27d-d10711b8c92f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:16.886032 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:17.064735 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-14bc8b08-cc21-4609-a27d-d10711b8c92f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:17.078528 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-14bc8b08-cc21-4609-a27d-d10711b8c92f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:17.080203 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-14bc8b08-cc21-4609-a27d-d10711b8c92f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:17.081499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-14bc8b08-cc21-4609-a27d-d10711b8c92f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1743 microversion: 2.20 time: 0.239573 Sep 01 17:43:17.082854 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 414/870] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:16 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1743 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:17.778176 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-437952d0-aa52-41ef-8780-5c01b352eead tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:17.779705 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-437952d0-aa52-41ef-8780-5c01b352eead tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:17.799247 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-437952d0-aa52-41ef-8780-5c01b352eead tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:17.800783 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-437952d0-aa52-41ef-8780-5c01b352eead tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:17.801503 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-437952d0-aa52-41ef-8780-5c01b352eead tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:17.807209 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-437952d0-aa52-41ef-8780-5c01b352eead tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:17.810881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-437952d0-aa52-41ef-8780-5c01b352eead tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:17.811712 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-437952d0-aa52-41ef-8780-5c01b352eead tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:17.820419 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=100 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:17.911442 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-437952d0-aa52-41ef-8780-5c01b352eead tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:17.927695 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-437952d0-aa52-41ef-8780-5c01b352eead tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1618 microversion: 2.1 time: 0.154764 Sep 01 17:43:17.931327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 457/871] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:17 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1618 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:18.113800 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-7e2fd9fc-fece-40ad-9ba7-830d6c5217d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:18.114571 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-7e2fd9fc-fece-40ad-9ba7-830d6c5217d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:18.121905 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7e2fd9fc-fece-40ad-9ba7-830d6c5217d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:18.122406 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7e2fd9fc-fece-40ad-9ba7-830d6c5217d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:18.123055 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7e2fd9fc-fece-40ad-9ba7-830d6c5217d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:18.123991 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7e2fd9fc-fece-40ad-9ba7-830d6c5217d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:18.124532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7e2fd9fc-fece-40ad-9ba7-830d6c5217d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:18.124889 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7e2fd9fc-fece-40ad-9ba7-830d6c5217d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:18.339858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7e2fd9fc-fece-40ad-9ba7-830d6c5217d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:18.350998 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7e2fd9fc-fece-40ad-9ba7-830d6c5217d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:18.352811 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7e2fd9fc-fece-40ad-9ba7-830d6c5217d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:18.354205 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-7e2fd9fc-fece-40ad-9ba7-830d6c5217d9 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1743 microversion: 2.20 time: 0.245351 Sep 01 17:43:18.365269 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 415/872] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:18 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:18.447643 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-a5be0018-a10e-4f04-bdff-6d085b7b4914 req-893bbb82-5bd5-4aa1-8185-05339483bbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72608990-e16b-4544-9ce6-d340d1c8c577", "name": "network-vif-deleted", "tag": "ec544ef7-b677-4f1d-8569-ad70326adfd8"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:18.469967 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a5be0018-a10e-4f04-bdff-6d085b7b4914 req-893bbb82-5bd5-4aa1-8185-05339483bbf2 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:18.474822 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a5be0018-a10e-4f04-bdff-6d085b7b4914 req-893bbb82-5bd5-4aa1-8185-05339483bbf2 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:18.476020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a5be0018-a10e-4f04-bdff-6d085b7b4914 req-893bbb82-5bd5-4aa1-8185-05339483bbf2 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:18.503344 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-a5be0018-a10e-4f04-bdff-6d085b7b4914 req-893bbb82-5bd5-4aa1-8185-05339483bbf2 service nova] Creating event network-vif-deleted:ec544ef7-b677-4f1d-8569-ad70326adfd8 for instance 72608990-e16b-4544-9ce6-d340d1c8c577 on hv-cinder-83976 Sep 01 17:43:18.509324 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-a5be0018-a10e-4f04-bdff-6d085b7b4914 req-893bbb82-5bd5-4aa1-8185-05339483bbf2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066584 Sep 01 17:43:18.510355 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 458/873] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:18.955264 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:18.956609 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:18.964846 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:18.965730 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:18.966490 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:18.967349 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:18.967942 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:18.968512 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:19.011753 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:19.012154 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:19.012732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:19.013193 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lazy-loading 'fault' on Instance uuid 72608990-e16b-4544-9ce6-d340d1c8c577 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:43:19.064623 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:19.073722 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-154baf1d-0a96-4764-bfd0-3415e9ae0469 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 200 len: 1335 microversion: 2.1 time: 0.124976 Sep 01 17:43:19.090089 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 416/874] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:18 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 1335 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:19.381481 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7b8aefec-718c-41d5-816e-918edafa20b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:19.382341 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7b8aefec-718c-41d5-816e-918edafa20b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:19.390562 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7b8aefec-718c-41d5-816e-918edafa20b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:19.391101 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7b8aefec-718c-41d5-816e-918edafa20b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:19.392191 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7b8aefec-718c-41d5-816e-918edafa20b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:19.393065 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7b8aefec-718c-41d5-816e-918edafa20b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:19.394498 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7b8aefec-718c-41d5-816e-918edafa20b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:19.395035 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7b8aefec-718c-41d5-816e-918edafa20b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:19.582505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7b8aefec-718c-41d5-816e-918edafa20b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:19.592399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7b8aefec-718c-41d5-816e-918edafa20b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:19.593964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7b8aefec-718c-41d5-816e-918edafa20b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:19.595214 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7b8aefec-718c-41d5-816e-918edafa20b6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1743 microversion: 2.20 time: 0.219032 Sep 01 17:43:19.603641 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 459/875] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:19 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1743 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:20.105172 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f2c50690-38fb-4727-9e7a-184285796861 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:20.106671 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f2c50690-38fb-4727-9e7a-184285796861 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:20.116610 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f2c50690-38fb-4727-9e7a-184285796861 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:20.117122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f2c50690-38fb-4727-9e7a-184285796861 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:20.117734 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f2c50690-38fb-4727-9e7a-184285796861 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:20.118786 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f2c50690-38fb-4727-9e7a-184285796861 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:20.119413 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f2c50690-38fb-4727-9e7a-184285796861 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:20.120090 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f2c50690-38fb-4727-9e7a-184285796861 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:20.140894 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-f2c50690-38fb-4727-9e7a-184285796861 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f2c50690-38fb-4727-9e7a-184285796861 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 HTTP/1.1 Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:43:20.143508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:43:20.145159 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:43:20.145159 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:43:20.145159 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:43:20.145159 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:43:20.145159 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:43:20.145159 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:43:20.145159 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:43:20.145159 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:43:20.145159 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:43:20.145159 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:43:20.145159 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:43:20.145159 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '72608990-e16b-4544-9ce6-d340d1c8c577'} Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:43:20.146075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:43:20.147336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:43:20.148499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f2c50690-38fb-4727-9e7a-184285796861 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 404 to user: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:43:20.148499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f2c50690-38fb-4727-9e7a-184285796861 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 404 len: 111 microversion: 2.1 time: 0.050089 Sep 01 17:43:20.148499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 417/876] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:20 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:43:20.155946 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7090ee66-201f-490a-b0ca-552f4e41c774 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '.version_select at 0x7f354a5703a0>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:20.180252 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7090ee66-201f-490a-b0ca-552f4e41c774 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-119185106" status: 202 len: 0 microversion: 2.1 time: 0.029111 Sep 01 17:43:20.181266 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 460/877] 10.222.0.100 () {58 vars in 1223 bytes} [Thu Sep 1 17:43:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-119185106 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:43:20.625691 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-14843ef1-d236-45dd-8fe9-2c5b84d2ba82 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:20.626455 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-14843ef1-d236-45dd-8fe9-2c5b84d2ba82 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:20.633890 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14843ef1-d236-45dd-8fe9-2c5b84d2ba82 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:20.634535 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14843ef1-d236-45dd-8fe9-2c5b84d2ba82 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:20.635092 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14843ef1-d236-45dd-8fe9-2c5b84d2ba82 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:20.635894 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14843ef1-d236-45dd-8fe9-2c5b84d2ba82 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:20.636602 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14843ef1-d236-45dd-8fe9-2c5b84d2ba82 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:20.637122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-14843ef1-d236-45dd-8fe9-2c5b84d2ba82 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:20.895353 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-14843ef1-d236-45dd-8fe9-2c5b84d2ba82 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:20.904712 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-14843ef1-d236-45dd-8fe9-2c5b84d2ba82 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:20.906260 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-14843ef1-d236-45dd-8fe9-2c5b84d2ba82 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:20.907500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-14843ef1-d236-45dd-8fe9-2c5b84d2ba82 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1725 microversion: 2.20 time: 0.286057 Sep 01 17:43:20.908404 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 418/878] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:20 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1725 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:21.058736 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-bffa3c44-1789-4b1b-b69e-582cd96f4b84 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Action: 'create', calling method: .version_select at 0x7f354a4dca60>, body: {"keypair": {"name": "tempest-keypair-1933242316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8QWQfepFNZZpvD7l90Do67O2q0QBQ3nqOl2bnKRfFrSqPkjfF8EzBQlmOZF5rA+IhTRX+CREsvlrgToVtlbmfvMHRQgN9FSSiQH0tMBaRA1OFwz2+eQpO3ccnyAqBweA=="}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:21.077700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-bffa3c44-1789-4b1b-b69e-582cd96f4b84 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for project 1cf7216d5c904b24a9665755720cf287. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:43:21.084154 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-bffa3c44-1789-4b1b-b69e-582cd96f4b84 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for user d3848643d2c44951b78814ccf7d504af and project 1cf7216d5c904b24a9665755720cf287. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:43:21.114218 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-bffa3c44-1789-4b1b-b69e-582cd96f4b84 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060322 Sep 01 17:43:21.114840 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 461/879] 10.222.0.100 () {60 vars in 1164 bytes} [Thu Sep 1 17:43:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:21.942951 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6ca30e6f-a73d-4501-88d5-5659f1569bf7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:21.943586 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6ca30e6f-a73d-4501-88d5-5659f1569bf7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:21.946153 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:21.951983 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ca30e6f-a73d-4501-88d5-5659f1569bf7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:21.952486 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ca30e6f-a73d-4501-88d5-5659f1569bf7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:21.952929 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ca30e6f-a73d-4501-88d5-5659f1569bf7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:21.953675 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ca30e6f-a73d-4501-88d5-5659f1569bf7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:21.954152 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ca30e6f-a73d-4501-88d5-5659f1569bf7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:21.954582 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ca30e6f-a73d-4501-88d5-5659f1569bf7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:22.127485 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6ca30e6f-a73d-4501-88d5-5659f1569bf7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:22.137815 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6ca30e6f-a73d-4501-88d5-5659f1569bf7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:22.139506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6ca30e6f-a73d-4501-88d5-5659f1569bf7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:22.140771 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6ca30e6f-a73d-4501-88d5-5659f1569bf7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1725 microversion: 2.20 time: 0.201960 Sep 01 17:43:22.141394 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 419/880] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:21 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:22.708475 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1415999471", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "633c7f8a-adb2-49f1-988f-caf4bcddf2dc"}], "security_groups": [{"name": "tempest-securitygroup--1299940358"}], "key_name": "tempest-keypair-1933242316", "user_data": "}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:22.830949 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.network.neutron [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] validate_networks() for [('633c7f8a-adb2-49f1-988f-caf4bcddf2dc', None, None, None, None, None)] {{(pid=127233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:43:23.166048 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2560e9cd-2f48-4349-b90a-72b0f3972821 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:23.166757 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2560e9cd-2f48-4349-b90a-72b0f3972821 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:23.173754 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2560e9cd-2f48-4349-b90a-72b0f3972821 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:23.174379 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2560e9cd-2f48-4349-b90a-72b0f3972821 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:23.175538 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2560e9cd-2f48-4349-b90a-72b0f3972821 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:23.176483 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2560e9cd-2f48-4349-b90a-72b0f3972821 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:23.177025 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2560e9cd-2f48-4349-b90a-72b0f3972821 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:23.177666 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2560e9cd-2f48-4349-b90a-72b0f3972821 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:23.334356 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Flavor limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:43:23.335125 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Image limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:43:23.335992 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Flavor pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:43:23.336792 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Image pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:43:23.337564 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:43:23.353332 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:23.354239 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:23.355042 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:23.356386 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:23.357242 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:23.358048 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:23.363650 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2560e9cd-2f48-4349-b90a-72b0f3972821 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:23.374555 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2560e9cd-2f48-4349-b90a-72b0f3972821 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:23.376005 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2560e9cd-2f48-4349-b90a-72b0f3972821 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:23.377205 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2560e9cd-2f48-4349-b90a-72b0f3972821 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1668 microversion: 2.20 time: 0.215379 Sep 01 17:43:23.378348 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 420/881] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:23 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1668 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:43:23.387117 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for project 1cf7216d5c904b24a9665755720cf287. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:43:23.391530 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Getting quotas for user d3848643d2c44951b78814ccf7d504af and project 1cf7216d5c904b24a9665755720cf287. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:43:23.404475 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Going to run 1 instances... {{(pid=127233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:43:23.406831 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:43:23.418938 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2b54e10a-7a0e-4e6e-bc9b-b2e38dae3083 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3266b42c-2256-4d9c-b0d7-451d43389537"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:23.423199 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2b54e10a-7a0e-4e6e-bc9b-b2e38dae3083 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:23.432456 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2b54e10a-7a0e-4e6e-bc9b-b2e38dae3083 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:23.432940 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2b54e10a-7a0e-4e6e-bc9b-b2e38dae3083 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:23.433378 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2b54e10a-7a0e-4e6e-bc9b-b2e38dae3083 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:23.434133 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2b54e10a-7a0e-4e6e-bc9b-b2e38dae3083 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:23.434581 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2b54e10a-7a0e-4e6e-bc9b-b2e38dae3083 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:23.435001 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2b54e10a-7a0e-4e6e-bc9b-b2e38dae3083 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:23.468578 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d91d6b8f-bd2a-45de-abfe-ffe4a56c9f5e tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.768355 Sep 01 17:43:23.470950 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 462/882] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:43:22 2022] POST /compute/v2.1/servers => generated 404 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:43:23.485616 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7eed147b-18d0-42a4-bf06-45392b0783d1 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:23.486503 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7eed147b-18d0-42a4-bf06-45392b0783d1 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:23.567388 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7eed147b-18d0-42a4-bf06-45392b0783d1 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:23.577744 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7eed147b-18d0-42a4-bf06-45392b0783d1 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1246 microversion: 2.1 time: 0.097215 Sep 01 17:43:23.581896 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 463/883] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:23 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:43:23.865846 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2b54e10a-7a0e-4e6e-bc9b-b2e38dae3083 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "POST /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.454572 Sep 01 17:43:23.866803 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 421/884] 10.222.0.100 () {62 vars in 1369 bytes} [Thu Sep 1 17:43:23 2022] POST /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/os-volume_attachments => generated 188 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:43:24.026790 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6d2c11b8-460a-4de9-9173-92c13795a5c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:24.027589 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6d2c11b8-460a-4de9-9173-92c13795a5c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:24.034825 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6d2c11b8-460a-4de9-9173-92c13795a5c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:24.035454 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6d2c11b8-460a-4de9-9173-92c13795a5c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:24.035893 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6d2c11b8-460a-4de9-9173-92c13795a5c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:24.036689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6d2c11b8-460a-4de9-9173-92c13795a5c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:24.037279 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6d2c11b8-460a-4de9-9173-92c13795a5c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:24.037873 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6d2c11b8-460a-4de9-9173-92c13795a5c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:24.418300 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-6d2c11b8-460a-4de9-9173-92c13795a5c7 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "DELETE /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/os-volume_attachments/3266b42c-2256-4d9c-b0d7-451d43389537" status: 202 len: 0 microversion: 2.20 time: 0.395405 Sep 01 17:43:24.418981 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 464/885] 10.222.0.100 () {60 vars in 1462 bytes} [Thu Sep 1 17:43:24 2022] DELETE /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/os-volume_attachments/3266b42c-2256-4d9c-b0d7-451d43389537 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:24.506443 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3f326ea5-7c4b-4e0a-af5c-d906aceee585 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:24.507683 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3f326ea5-7c4b-4e0a-af5c-d906aceee585 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:24.515153 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f326ea5-7c4b-4e0a-af5c-d906aceee585 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:24.515642 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f326ea5-7c4b-4e0a-af5c-d906aceee585 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:24.516077 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f326ea5-7c4b-4e0a-af5c-d906aceee585 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:24.516789 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f326ea5-7c4b-4e0a-af5c-d906aceee585 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:24.517237 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f326ea5-7c4b-4e0a-af5c-d906aceee585 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:24.517697 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f326ea5-7c4b-4e0a-af5c-d906aceee585 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:24.554951 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3f326ea5-7c4b-4e0a-af5c-d906aceee585 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127232) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 17:43:24.600903 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-de3817b5-f003-4227-be29-97439c3463be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:24.601517 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-de3817b5-f003-4227-be29-97439c3463be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:24.609353 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-de3817b5-f003-4227-be29-97439c3463be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:24.609878 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-de3817b5-f003-4227-be29-97439c3463be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:24.610309 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-de3817b5-f003-4227-be29-97439c3463be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:24.611022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-de3817b5-f003-4227-be29-97439c3463be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:24.611468 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-de3817b5-f003-4227-be29-97439c3463be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:24.611910 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-de3817b5-f003-4227-be29-97439c3463be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:24.669548 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-3f326ea5-7c4b-4e0a-af5c-d906aceee585 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "POST /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/action" status: 202 len: 0 microversion: 2.20 time: 0.167591 Sep 01 17:43:24.676036 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 422/886] 10.222.0.100 () {62 vars in 1324 bytes} [Thu Sep 1 17:43:24 2022] POST /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:24.685639 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b7907f1f-07eb-40b4-a1a2-798ccfe9177e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:24.687167 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b7907f1f-07eb-40b4-a1a2-798ccfe9177e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:24.699010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b7907f1f-07eb-40b4-a1a2-798ccfe9177e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:24.700286 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b7907f1f-07eb-40b4-a1a2-798ccfe9177e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:24.701076 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b7907f1f-07eb-40b4-a1a2-798ccfe9177e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:24.702441 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b7907f1f-07eb-40b4-a1a2-798ccfe9177e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:24.703295 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b7907f1f-07eb-40b4-a1a2-798ccfe9177e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:24.704075 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b7907f1f-07eb-40b4-a1a2-798ccfe9177e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:24.707142 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-de3817b5-f003-4227-be29-97439c3463be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:24.725463 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-de3817b5-f003-4227-be29-97439c3463be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1298 microversion: 2.1 time: 0.129281 Sep 01 17:43:24.727444 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 465/887] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:24 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1298 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:43:24.907163 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b7907f1f-07eb-40b4-a1a2-798ccfe9177e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:24.917370 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b7907f1f-07eb-40b4-a1a2-798ccfe9177e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:24.918937 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b7907f1f-07eb-40b4-a1a2-798ccfe9177e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:24.920183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b7907f1f-07eb-40b4-a1a2-798ccfe9177e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1676 microversion: 2.20 time: 0.242236 Sep 01 17:43:24.920773 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 423/888] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:24 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:24.924291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-5e0fcfb4-b396-42a5-bb7f-2e2dcf1eb371 req-5a400d4e-29ec-48ca-81e6-ff110d3421b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3623a32e-47b4-43dc-a80b-ca4254f4eaa5", "name": "network-vif-unplugged", "status": "completed", "tag": "67cfe8a5-3543-438d-a85f-436e1ad2ec3b"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:24.967947 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-5e0fcfb4-b396-42a5-bb7f-2e2dcf1eb371 req-5a400d4e-29ec-48ca-81e6-ff110d3421b6 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:24.969977 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-5e0fcfb4-b396-42a5-bb7f-2e2dcf1eb371 req-5a400d4e-29ec-48ca-81e6-ff110d3421b6 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:24.970971 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-5e0fcfb4-b396-42a5-bb7f-2e2dcf1eb371 req-5a400d4e-29ec-48ca-81e6-ff110d3421b6 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:25.008870 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.compute.server_external_events [req-5e0fcfb4-b396-42a5-bb7f-2e2dcf1eb371 req-5a400d4e-29ec-48ca-81e6-ff110d3421b6 service nova] Unable to find a host for instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5. Dropping event network-vif-unplugged {{(pid=127233) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 17:43:25.010298 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-5e0fcfb4-b396-42a5-bb7f-2e2dcf1eb371 req-5a400d4e-29ec-48ca-81e6-ff110d3421b6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.096770 Sep 01 17:43:25.011345 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 466/889] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 99 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 17:43:25.753265 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-685d9e78-9cc7-411b-80f5-f65c60b19c1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:25.754724 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-685d9e78-9cc7-411b-80f5-f65c60b19c1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:25.762635 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-685d9e78-9cc7-411b-80f5-f65c60b19c1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:25.763112 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-685d9e78-9cc7-411b-80f5-f65c60b19c1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:25.763737 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-685d9e78-9cc7-411b-80f5-f65c60b19c1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:25.764647 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-685d9e78-9cc7-411b-80f5-f65c60b19c1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:25.765110 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-685d9e78-9cc7-411b-80f5-f65c60b19c1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:25.765535 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-685d9e78-9cc7-411b-80f5-f65c60b19c1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:25.841073 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-685d9e78-9cc7-411b-80f5-f65c60b19c1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:25.851252 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-685d9e78-9cc7-411b-80f5-f65c60b19c1d tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1304 microversion: 2.1 time: 0.103715 Sep 01 17:43:25.852327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 424/890] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:25 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:43:25.962778 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ad4fef8f-27f3-4832-b81b-9671e6025b99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:25.963783 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ad4fef8f-27f3-4832-b81b-9671e6025b99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:25.978937 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad4fef8f-27f3-4832-b81b-9671e6025b99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:25.980275 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad4fef8f-27f3-4832-b81b-9671e6025b99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:25.981197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad4fef8f-27f3-4832-b81b-9671e6025b99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:25.982703 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad4fef8f-27f3-4832-b81b-9671e6025b99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:25.985395 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad4fef8f-27f3-4832-b81b-9671e6025b99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:25.986388 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad4fef8f-27f3-4832-b81b-9671e6025b99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:26.301009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ad4fef8f-27f3-4832-b81b-9671e6025b99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:26.321699 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ad4fef8f-27f3-4832-b81b-9671e6025b99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:26.324245 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ad4fef8f-27f3-4832-b81b-9671e6025b99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:26.325517 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ad4fef8f-27f3-4832-b81b-9671e6025b99 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1676 microversion: 2.20 time: 0.370575 Sep 01 17:43:26.326465 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 467/891] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:25 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1676 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:43:26.878590 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-7632b7c9-623e-493f-8828-b412fbafbf2c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:26.879865 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-7632b7c9-623e-493f-8828-b412fbafbf2c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:26.890209 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7632b7c9-623e-493f-8828-b412fbafbf2c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:26.890701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7632b7c9-623e-493f-8828-b412fbafbf2c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:26.891225 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7632b7c9-623e-493f-8828-b412fbafbf2c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:26.892548 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7632b7c9-623e-493f-8828-b412fbafbf2c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:26.894054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7632b7c9-623e-493f-8828-b412fbafbf2c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:26.894815 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7632b7c9-623e-493f-8828-b412fbafbf2c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:27.162162 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7632b7c9-623e-493f-8828-b412fbafbf2c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:27.178824 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-7632b7c9-623e-493f-8828-b412fbafbf2c tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1372 microversion: 2.1 time: 0.307393 Sep 01 17:43:27.179903 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 425/892] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:26 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1372 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:27.278431 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-a48cd345-9f3b-4a3f-8aa8-2554d7542e25 req-25a84581-0758-4ac6-b411-1a7b5c40acb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef9599ab-1a96-43d5-8c63-03f62d3d2700", "tag": "c65a97d3-50de-4e75-8bde-ed4f1c7c8aab"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:27.313143 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a48cd345-9f3b-4a3f-8aa8-2554d7542e25 req-25a84581-0758-4ac6-b411-1a7b5c40acb7 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:27.314229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a48cd345-9f3b-4a3f-8aa8-2554d7542e25 req-25a84581-0758-4ac6-b411-1a7b5c40acb7 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:27.315164 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a48cd345-9f3b-4a3f-8aa8-2554d7542e25 req-25a84581-0758-4ac6-b411-1a7b5c40acb7 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:27.335853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-a48cd345-9f3b-4a3f-8aa8-2554d7542e25 req-25a84581-0758-4ac6-b411-1a7b5c40acb7 service nova] Creating event network-changed:c65a97d3-50de-4e75-8bde-ed4f1c7c8aab for instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 on hv-cinder-83976 Sep 01 17:43:27.344923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-a48cd345-9f3b-4a3f-8aa8-2554d7542e25 req-25a84581-0758-4ac6-b411-1a7b5c40acb7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081819 Sep 01 17:43:27.347110 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 468/893] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:27.373474 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-39d75d89-89ca-4ed7-a3dd-37d4867ef9d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:27.374137 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-39d75d89-89ca-4ed7-a3dd-37d4867ef9d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:27.388211 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39d75d89-89ca-4ed7-a3dd-37d4867ef9d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:27.389514 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39d75d89-89ca-4ed7-a3dd-37d4867ef9d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:27.390660 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39d75d89-89ca-4ed7-a3dd-37d4867ef9d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:27.392246 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39d75d89-89ca-4ed7-a3dd-37d4867ef9d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:27.393389 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39d75d89-89ca-4ed7-a3dd-37d4867ef9d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:27.394437 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-39d75d89-89ca-4ed7-a3dd-37d4867ef9d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:27.676761 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-39d75d89-89ca-4ed7-a3dd-37d4867ef9d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:27.693801 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-39d75d89-89ca-4ed7-a3dd-37d4867ef9d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:27.697096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-39d75d89-89ca-4ed7-a3dd-37d4867ef9d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:27.699721 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-39d75d89-89ca-4ed7-a3dd-37d4867ef9d5 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.339321 Sep 01 17:43:27.701102 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 426/894] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:27 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:28.214389 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2d32e82c-448a-4877-b9bf-129cfa6d06e8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:28.215258 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2d32e82c-448a-4877-b9bf-129cfa6d06e8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:28.222549 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d32e82c-448a-4877-b9bf-129cfa6d06e8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:28.223043 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d32e82c-448a-4877-b9bf-129cfa6d06e8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:28.223482 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d32e82c-448a-4877-b9bf-129cfa6d06e8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:28.224207 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d32e82c-448a-4877-b9bf-129cfa6d06e8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:28.224671 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d32e82c-448a-4877-b9bf-129cfa6d06e8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:28.225096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2d32e82c-448a-4877-b9bf-129cfa6d06e8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:28.369386 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2d32e82c-448a-4877-b9bf-129cfa6d06e8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:28.377257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2d32e82c-448a-4877-b9bf-129cfa6d06e8 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1372 microversion: 2.1 time: 0.167868 Sep 01 17:43:28.378423 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 469/895] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:28 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:43:28.725604 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b6d714cc-632c-4974-a22a-faf4c7ba1278 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:28.726208 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b6d714cc-632c-4974-a22a-faf4c7ba1278 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:28.733530 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b6d714cc-632c-4974-a22a-faf4c7ba1278 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:28.734042 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b6d714cc-632c-4974-a22a-faf4c7ba1278 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:28.734477 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b6d714cc-632c-4974-a22a-faf4c7ba1278 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:28.735171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b6d714cc-632c-4974-a22a-faf4c7ba1278 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:28.735621 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b6d714cc-632c-4974-a22a-faf4c7ba1278 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:28.736039 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b6d714cc-632c-4974-a22a-faf4c7ba1278 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:28.913092 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b6d714cc-632c-4974-a22a-faf4c7ba1278 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:28.915896 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:28.929714 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b6d714cc-632c-4974-a22a-faf4c7ba1278 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:28.932287 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b6d714cc-632c-4974-a22a-faf4c7ba1278 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:28.934373 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b6d714cc-632c-4974-a22a-faf4c7ba1278 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.213128 Sep 01 17:43:28.935154 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 427/896] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:28 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:29.475344 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0a3b8e8f-ddda-4ff3-8828-0fe3d362cbd7 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:29.476000 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-0a3b8e8f-ddda-4ff3-8828-0fe3d362cbd7 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:29.486485 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0a3b8e8f-ddda-4ff3-8828-0fe3d362cbd7 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:29.487717 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0a3b8e8f-ddda-4ff3-8828-0fe3d362cbd7 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:29.488273 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0a3b8e8f-ddda-4ff3-8828-0fe3d362cbd7 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:29.489264 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0a3b8e8f-ddda-4ff3-8828-0fe3d362cbd7 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:29.489779 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0a3b8e8f-ddda-4ff3-8828-0fe3d362cbd7 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:29.490215 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-0a3b8e8f-ddda-4ff3-8828-0fe3d362cbd7 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:29.683593 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-0a3b8e8f-ddda-4ff3-8828-0fe3d362cbd7 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:29.695530 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0a3b8e8f-ddda-4ff3-8828-0fe3d362cbd7 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1372 microversion: 2.1 time: 0.299773 Sep 01 17:43:29.696391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 470/897] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:29 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1372 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:29.964068 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6547933c-45bc-4b6a-83d9-907d88efc18b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:29.965257 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6547933c-45bc-4b6a-83d9-907d88efc18b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:29.980222 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6547933c-45bc-4b6a-83d9-907d88efc18b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:29.981180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6547933c-45bc-4b6a-83d9-907d88efc18b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:29.982341 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6547933c-45bc-4b6a-83d9-907d88efc18b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:29.983710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6547933c-45bc-4b6a-83d9-907d88efc18b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:29.984646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6547933c-45bc-4b6a-83d9-907d88efc18b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:29.985796 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6547933c-45bc-4b6a-83d9-907d88efc18b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:30.199194 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6547933c-45bc-4b6a-83d9-907d88efc18b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:30.224409 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6547933c-45bc-4b6a-83d9-907d88efc18b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:30.226144 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6547933c-45bc-4b6a-83d9-907d88efc18b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:30.227518 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6547933c-45bc-4b6a-83d9-907d88efc18b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.271598 Sep 01 17:43:30.229510 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 428/898] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:29 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:43:30.723642 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-33f8fe34-f3de-48b2-944b-6a396892260b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:30.726668 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-33f8fe34-f3de-48b2-944b-6a396892260b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:30.748061 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-33f8fe34-f3de-48b2-944b-6a396892260b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:30.748818 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-33f8fe34-f3de-48b2-944b-6a396892260b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:30.749755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-33f8fe34-f3de-48b2-944b-6a396892260b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:30.750832 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-33f8fe34-f3de-48b2-944b-6a396892260b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:30.751456 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-33f8fe34-f3de-48b2-944b-6a396892260b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:30.752189 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-33f8fe34-f3de-48b2-944b-6a396892260b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:31.007710 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-33f8fe34-f3de-48b2-944b-6a396892260b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:31.018489 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-33f8fe34-f3de-48b2-944b-6a396892260b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1372 microversion: 2.1 time: 0.303746 Sep 01 17:43:31.031793 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 471/899] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:30 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1372 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:31.264545 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3f9adf63-fa19-45ec-801d-2f2f152ad11a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:31.267521 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3f9adf63-fa19-45ec-801d-2f2f152ad11a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:31.286353 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f9adf63-fa19-45ec-801d-2f2f152ad11a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:31.287697 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f9adf63-fa19-45ec-801d-2f2f152ad11a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:31.289603 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f9adf63-fa19-45ec-801d-2f2f152ad11a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:31.291621 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f9adf63-fa19-45ec-801d-2f2f152ad11a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:31.292729 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f9adf63-fa19-45ec-801d-2f2f152ad11a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:31.294079 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3f9adf63-fa19-45ec-801d-2f2f152ad11a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:31.508010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3f9adf63-fa19-45ec-801d-2f2f152ad11a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:31.525148 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3f9adf63-fa19-45ec-801d-2f2f152ad11a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:31.526949 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3f9adf63-fa19-45ec-801d-2f2f152ad11a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:31.528153 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-3f9adf63-fa19-45ec-801d-2f2f152ad11a tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.271224 Sep 01 17:43:31.528727 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 429/900] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:31 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:32.044522 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a7265f3d-fae7-4ffd-b0d9-1bae3d2a1b70 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:32.046693 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a7265f3d-fae7-4ffd-b0d9-1bae3d2a1b70 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:32.058294 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a7265f3d-fae7-4ffd-b0d9-1bae3d2a1b70 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:32.059245 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a7265f3d-fae7-4ffd-b0d9-1bae3d2a1b70 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:32.060052 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a7265f3d-fae7-4ffd-b0d9-1bae3d2a1b70 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:32.061460 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a7265f3d-fae7-4ffd-b0d9-1bae3d2a1b70 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:32.062478 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a7265f3d-fae7-4ffd-b0d9-1bae3d2a1b70 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:32.063647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a7265f3d-fae7-4ffd-b0d9-1bae3d2a1b70 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:32.249942 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a7265f3d-fae7-4ffd-b0d9-1bae3d2a1b70 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:32.261793 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a7265f3d-fae7-4ffd-b0d9-1bae3d2a1b70 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1372 microversion: 2.1 time: 0.224281 Sep 01 17:43:32.262575 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 472/901] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:32 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1372 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:43:32.555158 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b3dd99eb-ebc4-4b88-8395-cf91e7f01ab8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:32.555760 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b3dd99eb-ebc4-4b88-8395-cf91e7f01ab8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:32.562928 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b3dd99eb-ebc4-4b88-8395-cf91e7f01ab8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:32.563450 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b3dd99eb-ebc4-4b88-8395-cf91e7f01ab8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:32.563976 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b3dd99eb-ebc4-4b88-8395-cf91e7f01ab8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:32.568132 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b3dd99eb-ebc4-4b88-8395-cf91e7f01ab8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:32.568878 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b3dd99eb-ebc4-4b88-8395-cf91e7f01ab8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:32.569341 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b3dd99eb-ebc4-4b88-8395-cf91e7f01ab8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:32.781755 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b3dd99eb-ebc4-4b88-8395-cf91e7f01ab8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:32.793026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b3dd99eb-ebc4-4b88-8395-cf91e7f01ab8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:32.804038 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b3dd99eb-ebc4-4b88-8395-cf91e7f01ab8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:32.805343 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b3dd99eb-ebc4-4b88-8395-cf91e7f01ab8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.254152 Sep 01 17:43:32.805889 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 430/902] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:32 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:32.936011 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-a2945f1c-510e-4dc5-8e39-102678070fd9 req-8f09561c-9755-4586-a80e-7b61150eea05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef9599ab-1a96-43d5-8c63-03f62d3d2700", "name": "network-vif-plugged", "status": "completed", "tag": "c65a97d3-50de-4e75-8bde-ed4f1c7c8aab"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:32.946775 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a2945f1c-510e-4dc5-8e39-102678070fd9 req-8f09561c-9755-4586-a80e-7b61150eea05 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:32.947541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a2945f1c-510e-4dc5-8e39-102678070fd9 req-8f09561c-9755-4586-a80e-7b61150eea05 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:32.948128 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-a2945f1c-510e-4dc5-8e39-102678070fd9 req-8f09561c-9755-4586-a80e-7b61150eea05 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:32.964268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-a2945f1c-510e-4dc5-8e39-102678070fd9 req-8f09561c-9755-4586-a80e-7b61150eea05 service nova] Creating event network-vif-plugged:c65a97d3-50de-4e75-8bde-ed4f1c7c8aab for instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 on hv-cinder-83976 Sep 01 17:43:32.976453 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-a2945f1c-510e-4dc5-8e39-102678070fd9 req-8f09561c-9755-4586-a80e-7b61150eea05 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044054 Sep 01 17:43:32.977703 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 473/903] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:33.301637 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-18387d17-c974-4f6c-9636-fec53a734a2f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:33.302270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-18387d17-c974-4f6c-9636-fec53a734a2f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:33.310111 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-18387d17-c974-4f6c-9636-fec53a734a2f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:33.310801 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-18387d17-c974-4f6c-9636-fec53a734a2f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:33.311375 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-18387d17-c974-4f6c-9636-fec53a734a2f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:33.312146 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-18387d17-c974-4f6c-9636-fec53a734a2f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:33.312716 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-18387d17-c974-4f6c-9636-fec53a734a2f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:33.313216 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-18387d17-c974-4f6c-9636-fec53a734a2f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:33.492712 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-18387d17-c974-4f6c-9636-fec53a734a2f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:33.506033 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-18387d17-c974-4f6c-9636-fec53a734a2f tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1372 microversion: 2.1 time: 0.210407 Sep 01 17:43:33.506695 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 431/904] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:33 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1372 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:33.827499 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:33.828391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=12 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:33.834019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4153fdf7-9942-4a02-9eab-0927738a7e89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:33.835264 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4153fdf7-9942-4a02-9eab-0927738a7e89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:33.851533 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4153fdf7-9942-4a02-9eab-0927738a7e89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:33.852754 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4153fdf7-9942-4a02-9eab-0927738a7e89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:33.853830 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4153fdf7-9942-4a02-9eab-0927738a7e89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:33.855333 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4153fdf7-9942-4a02-9eab-0927738a7e89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:33.856742 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4153fdf7-9942-4a02-9eab-0927738a7e89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:33.857486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4153fdf7-9942-4a02-9eab-0927738a7e89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:34.065267 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4153fdf7-9942-4a02-9eab-0927738a7e89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:34.077422 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4153fdf7-9942-4a02-9eab-0927738a7e89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:34.079393 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4153fdf7-9942-4a02-9eab-0927738a7e89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:34.082487 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4153fdf7-9942-4a02-9eab-0927738a7e89 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.255810 Sep 01 17:43:34.083940 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 474/905] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:33 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:43:34.539134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ce6c261c-2446-42a7-b351-cc7c060da912 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:34.540711 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ce6c261c-2446-42a7-b351-cc7c060da912 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:34.557550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ce6c261c-2446-42a7-b351-cc7c060da912 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:34.558176 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ce6c261c-2446-42a7-b351-cc7c060da912 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:34.558688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ce6c261c-2446-42a7-b351-cc7c060da912 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:34.559491 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ce6c261c-2446-42a7-b351-cc7c060da912 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:34.560020 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ce6c261c-2446-42a7-b351-cc7c060da912 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:34.560520 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ce6c261c-2446-42a7-b351-cc7c060da912 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:34.789433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ce6c261c-2446-42a7-b351-cc7c060da912 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:34.794779 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-fb78cf41-0169-4929-a236-6573abd96673 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:34.800234 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-fb78cf41-0169-4929-a236-6573abd96673 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:34.806213 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ce6c261c-2446-42a7-b351-cc7c060da912 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1372 microversion: 2.1 time: 0.270754 Sep 01 17:43:34.807726 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fb78cf41-0169-4929-a236-6573abd96673 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:34.808404 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fb78cf41-0169-4929-a236-6573abd96673 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:34.809022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fb78cf41-0169-4929-a236-6573abd96673 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:34.809981 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fb78cf41-0169-4929-a236-6573abd96673 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:34.810620 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fb78cf41-0169-4929-a236-6573abd96673 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:34.811235 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fb78cf41-0169-4929-a236-6573abd96673 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:34.821951 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 432/906] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:34 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1372 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:34.842322 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-fb78cf41-0169-4929-a236-6573abd96673 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/ips" status: 200 len: 144 microversion: 2.1 time: 0.062771 Sep 01 17:43:34.853895 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 475/907] 10.222.0.100 () {58 vars in 1253 bytes} [Thu Sep 1 17:43:34 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/ips => generated 144 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:35.110741 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e980d1a3-655a-4c84-a544-f2e8e1ab0e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:35.111299 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e980d1a3-655a-4c84-a544-f2e8e1ab0e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:35.118543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e980d1a3-655a-4c84-a544-f2e8e1ab0e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:35.119195 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e980d1a3-655a-4c84-a544-f2e8e1ab0e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:35.119638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e980d1a3-655a-4c84-a544-f2e8e1ab0e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:35.120352 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e980d1a3-655a-4c84-a544-f2e8e1ab0e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:35.121094 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e980d1a3-655a-4c84-a544-f2e8e1ab0e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:35.121463 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e980d1a3-655a-4c84-a544-f2e8e1ab0e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:35.302659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e980d1a3-655a-4c84-a544-f2e8e1ab0e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:35.312387 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e980d1a3-655a-4c84-a544-f2e8e1ab0e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:35.314734 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e980d1a3-655a-4c84-a544-f2e8e1ab0e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:35.317325 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e980d1a3-655a-4c84-a544-f2e8e1ab0e08 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.210788 Sep 01 17:43:35.318544 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 433/908] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:35 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:35.843119 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-fc68dde8-dadb-4c41-b2cf-3a7384b14542 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:35.845138 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-fc68dde8-dadb-4c41-b2cf-3a7384b14542 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:35.858210 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fc68dde8-dadb-4c41-b2cf-3a7384b14542 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:35.859444 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fc68dde8-dadb-4c41-b2cf-3a7384b14542 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:35.860371 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fc68dde8-dadb-4c41-b2cf-3a7384b14542 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:35.863808 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fc68dde8-dadb-4c41-b2cf-3a7384b14542 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:35.865193 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fc68dde8-dadb-4c41-b2cf-3a7384b14542 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:35.868263 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fc68dde8-dadb-4c41-b2cf-3a7384b14542 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:36.178423 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-fc68dde8-dadb-4c41-b2cf-3a7384b14542 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:36.198716 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-fc68dde8-dadb-4c41-b2cf-3a7384b14542 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1372 microversion: 2.1 time: 0.365319 Sep 01 17:43:36.199427 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 476/909] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:35 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1372 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:36.352635 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ff1f06ef-3182-4c87-b865-2eb63d149c56 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:36.353203 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ff1f06ef-3182-4c87-b865-2eb63d149c56 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:36.360359 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ff1f06ef-3182-4c87-b865-2eb63d149c56 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:36.360974 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ff1f06ef-3182-4c87-b865-2eb63d149c56 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:36.361425 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ff1f06ef-3182-4c87-b865-2eb63d149c56 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:36.362891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ff1f06ef-3182-4c87-b865-2eb63d149c56 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:36.363353 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ff1f06ef-3182-4c87-b865-2eb63d149c56 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:36.363784 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ff1f06ef-3182-4c87-b865-2eb63d149c56 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:36.521446 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ff1f06ef-3182-4c87-b865-2eb63d149c56 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:36.546102 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ff1f06ef-3182-4c87-b865-2eb63d149c56 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:36.547677 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ff1f06ef-3182-4c87-b865-2eb63d149c56 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:36.548954 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ff1f06ef-3182-4c87-b865-2eb63d149c56 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.200358 Sep 01 17:43:36.550666 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 434/910] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:36 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:37.169716 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-256be64e-9288-4b05-bca1-0a1f858c742f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1817aa04-5b76-4687-8f31-5d32ca044dbc"}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:37.172125 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-256be64e-9288-4b05-bca1-0a1f858c742f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:37.178801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-256be64e-9288-4b05-bca1-0a1f858c742f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:37.179335 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-256be64e-9288-4b05-bca1-0a1f858c742f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:37.179726 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-256be64e-9288-4b05-bca1-0a1f858c742f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:37.180581 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-256be64e-9288-4b05-bca1-0a1f858c742f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:37.181049 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-256be64e-9288-4b05-bca1-0a1f858c742f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:37.181473 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-256be64e-9288-4b05-bca1-0a1f858c742f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:37.222062 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-7f823347-37c7-4429-8bbc-09a824079efb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:37.222692 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-7f823347-37c7-4429-8bbc-09a824079efb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:37.228992 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7f823347-37c7-4429-8bbc-09a824079efb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:37.229487 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7f823347-37c7-4429-8bbc-09a824079efb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:37.229950 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7f823347-37c7-4429-8bbc-09a824079efb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:37.230663 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7f823347-37c7-4429-8bbc-09a824079efb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:37.231121 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7f823347-37c7-4429-8bbc-09a824079efb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:37.231548 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7f823347-37c7-4429-8bbc-09a824079efb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:37.270952 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:37.382370 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7f823347-37c7-4429-8bbc-09a824079efb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:37.390399 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-7f823347-37c7-4429-8bbc-09a824079efb tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1372 microversion: 2.1 time: 0.173513 Sep 01 17:43:37.390966 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 435/911] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:37 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:37.572746 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-225582f6-c00f-4f81-b68f-1f310b38499b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:37.573370 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-225582f6-c00f-4f81-b68f-1f310b38499b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:37.579422 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-225582f6-c00f-4f81-b68f-1f310b38499b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:37.579901 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-225582f6-c00f-4f81-b68f-1f310b38499b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:37.580340 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-225582f6-c00f-4f81-b68f-1f310b38499b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:37.581100 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-225582f6-c00f-4f81-b68f-1f310b38499b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:37.581595 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-225582f6-c00f-4f81-b68f-1f310b38499b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:37.582029 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-225582f6-c00f-4f81-b68f-1f310b38499b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:37.739274 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-225582f6-c00f-4f81-b68f-1f310b38499b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:37.754872 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-225582f6-c00f-4f81-b68f-1f310b38499b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:37.756576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-225582f6-c00f-4f81-b68f-1f310b38499b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:37.757901 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-225582f6-c00f-4f81-b68f-1f310b38499b tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.189015 Sep 01 17:43:37.758453 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 436/912] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:37 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:43:37.855168 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-256be64e-9288-4b05-bca1-0a1f858c742f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "POST /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689562 Sep 01 17:43:37.855777 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 477/913] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:43:37 2022] POST /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/os-volume_attachments => generated 194 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:38.412786 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-edae3fc4-873d-472d-b2e7-cbf83627d214 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:38.413720 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-edae3fc4-873d-472d-b2e7-cbf83627d214 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:38.421051 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-edae3fc4-873d-472d-b2e7-cbf83627d214 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:38.421557 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-edae3fc4-873d-472d-b2e7-cbf83627d214 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:38.422028 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-edae3fc4-873d-472d-b2e7-cbf83627d214 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:38.422749 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-edae3fc4-873d-472d-b2e7-cbf83627d214 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:38.423209 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-edae3fc4-873d-472d-b2e7-cbf83627d214 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:38.423637 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-edae3fc4-873d-472d-b2e7-cbf83627d214 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:38.606937 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-edae3fc4-873d-472d-b2e7-cbf83627d214 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:38.615783 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-edae3fc4-873d-472d-b2e7-cbf83627d214 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1372 microversion: 2.1 time: 0.207587 Sep 01 17:43:38.616376 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 437/914] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:38 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:38.788818 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-671498a9-aa90-4954-8286-443e9b57b163 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:38.790723 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-671498a9-aa90-4954-8286-443e9b57b163 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:38.803684 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-671498a9-aa90-4954-8286-443e9b57b163 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:38.806166 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-671498a9-aa90-4954-8286-443e9b57b163 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:38.807223 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-671498a9-aa90-4954-8286-443e9b57b163 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:38.808106 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-671498a9-aa90-4954-8286-443e9b57b163 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:38.808636 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-671498a9-aa90-4954-8286-443e9b57b163 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:38.809985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-671498a9-aa90-4954-8286-443e9b57b163 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:39.027644 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-671498a9-aa90-4954-8286-443e9b57b163 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:39.037459 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-671498a9-aa90-4954-8286-443e9b57b163 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:39.039000 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-671498a9-aa90-4954-8286-443e9b57b163 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:39.040443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-671498a9-aa90-4954-8286-443e9b57b163 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.261822 Sep 01 17:43:39.041001 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 478/915] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:38 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:39.639813 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-1e53e2fa-2e27-4186-a5b5-9b3961325986 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:39.640475 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-1e53e2fa-2e27-4186-a5b5-9b3961325986 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:39.647867 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1e53e2fa-2e27-4186-a5b5-9b3961325986 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:39.648615 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1e53e2fa-2e27-4186-a5b5-9b3961325986 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:39.649158 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1e53e2fa-2e27-4186-a5b5-9b3961325986 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:39.650299 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1e53e2fa-2e27-4186-a5b5-9b3961325986 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:39.650848 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1e53e2fa-2e27-4186-a5b5-9b3961325986 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:39.651489 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1e53e2fa-2e27-4186-a5b5-9b3961325986 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:39.807894 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1e53e2fa-2e27-4186-a5b5-9b3961325986 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:39.822028 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-1e53e2fa-2e27-4186-a5b5-9b3961325986 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1372 microversion: 2.1 time: 0.185666 Sep 01 17:43:39.823053 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 438/916] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:39 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:40.064409 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d641f6a2-f3a7-4db6-9903-2f323833bacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:40.065027 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d641f6a2-f3a7-4db6-9903-2f323833bacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:40.072341 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d641f6a2-f3a7-4db6-9903-2f323833bacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:40.073215 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d641f6a2-f3a7-4db6-9903-2f323833bacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:40.073684 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d641f6a2-f3a7-4db6-9903-2f323833bacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:40.074396 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d641f6a2-f3a7-4db6-9903-2f323833bacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:40.074863 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d641f6a2-f3a7-4db6-9903-2f323833bacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:40.075295 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d641f6a2-f3a7-4db6-9903-2f323833bacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:40.215057 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d641f6a2-f3a7-4db6-9903-2f323833bacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:40.223715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d641f6a2-f3a7-4db6-9903-2f323833bacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:40.225187 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d641f6a2-f3a7-4db6-9903-2f323833bacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:40.226466 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d641f6a2-f3a7-4db6-9903-2f323833bacb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.166017 Sep 01 17:43:40.227036 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 479/917] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:40 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:40.853239 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-24db4596-f361-49be-987d-f7a0281eb2db tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:40.853913 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-24db4596-f361-49be-987d-f7a0281eb2db tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:40.860816 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24db4596-f361-49be-987d-f7a0281eb2db tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:40.861311 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24db4596-f361-49be-987d-f7a0281eb2db tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:40.862365 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24db4596-f361-49be-987d-f7a0281eb2db tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:40.863105 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24db4596-f361-49be-987d-f7a0281eb2db tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:40.863566 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24db4596-f361-49be-987d-f7a0281eb2db tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:40.864003 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-24db4596-f361-49be-987d-f7a0281eb2db tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:41.024140 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-24db4596-f361-49be-987d-f7a0281eb2db tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:41.034444 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-24db4596-f361-49be-987d-f7a0281eb2db tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1562 microversion: 2.1 time: 0.184487 Sep 01 17:43:41.035880 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 439/918] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:40 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1562 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:41.057950 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-813e5008-2eb6-414d-8b5d-b10c634d38a3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:41.058845 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-813e5008-2eb6-414d-8b5d-b10c634d38a3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:41.062442 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:41.073166 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-813e5008-2eb6-414d-8b5d-b10c634d38a3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:41.074484 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-813e5008-2eb6-414d-8b5d-b10c634d38a3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:41.075175 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-813e5008-2eb6-414d-8b5d-b10c634d38a3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:41.075780 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-813e5008-2eb6-414d-8b5d-b10c634d38a3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:41.076337 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-813e5008-2eb6-414d-8b5d-b10c634d38a3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:41.076771 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-813e5008-2eb6-414d-8b5d-b10c634d38a3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:41.181421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-813e5008-2eb6-414d-8b5d-b10c634d38a3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129210 Sep 01 17:43:41.182157 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 480/919] 10.222.0.100 () {58 vars in 1280 bytes} [Thu Sep 1 17:43:41 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:41.253963 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c87a7c4e-a3a0-4425-9da0-484449ec63f2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:41.255014 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c87a7c4e-a3a0-4425-9da0-484449ec63f2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:41.263136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c87a7c4e-a3a0-4425-9da0-484449ec63f2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:41.264208 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c87a7c4e-a3a0-4425-9da0-484449ec63f2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:41.264663 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c87a7c4e-a3a0-4425-9da0-484449ec63f2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:41.265462 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c87a7c4e-a3a0-4425-9da0-484449ec63f2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:41.266003 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c87a7c4e-a3a0-4425-9da0-484449ec63f2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:41.266434 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c87a7c4e-a3a0-4425-9da0-484449ec63f2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:41.804861 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c87a7c4e-a3a0-4425-9da0-484449ec63f2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:41.814139 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c87a7c4e-a3a0-4425-9da0-484449ec63f2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:41.815704 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c87a7c4e-a3a0-4425-9da0-484449ec63f2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:41.817149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c87a7c4e-a3a0-4425-9da0-484449ec63f2 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.570776 Sep 01 17:43:41.817958 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 440/920] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:41 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:42.651554 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-8fd87e69-80a5-4b4e-849a-4404d62133ca req-45df9d73-83e7-495f-8497-189247324e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef9599ab-1a96-43d5-8c63-03f62d3d2700", "tag": "c65a97d3-50de-4e75-8bde-ed4f1c7c8aab"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:42.665246 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-8fd87e69-80a5-4b4e-849a-4404d62133ca req-45df9d73-83e7-495f-8497-189247324e4c service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:42.665810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-8fd87e69-80a5-4b4e-849a-4404d62133ca req-45df9d73-83e7-495f-8497-189247324e4c service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:42.666215 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-8fd87e69-80a5-4b4e-849a-4404d62133ca req-45df9d73-83e7-495f-8497-189247324e4c service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:42.680396 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-8fd87e69-80a5-4b4e-849a-4404d62133ca req-45df9d73-83e7-495f-8497-189247324e4c service nova] Creating event network-changed:c65a97d3-50de-4e75-8bde-ed4f1c7c8aab for instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 on hv-cinder-83976 Sep 01 17:43:42.686068 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-8fd87e69-80a5-4b4e-849a-4404d62133ca req-45df9d73-83e7-495f-8497-189247324e4c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038431 Sep 01 17:43:42.686700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 481/921] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:43:42.841107 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8ca5cb78-859d-46cc-930b-a4231235ade6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:42.841745 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8ca5cb78-859d-46cc-930b-a4231235ade6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:42.849198 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ca5cb78-859d-46cc-930b-a4231235ade6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:42.850043 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ca5cb78-859d-46cc-930b-a4231235ade6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:42.850705 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ca5cb78-859d-46cc-930b-a4231235ade6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:42.852090 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ca5cb78-859d-46cc-930b-a4231235ade6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:42.852772 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ca5cb78-859d-46cc-930b-a4231235ade6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:42.853360 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ca5cb78-859d-46cc-930b-a4231235ade6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:43.039600 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8ca5cb78-859d-46cc-930b-a4231235ade6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:43.051991 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8ca5cb78-859d-46cc-930b-a4231235ade6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:43.054194 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8ca5cb78-859d-46cc-930b-a4231235ade6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:43.055654 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8ca5cb78-859d-46cc-930b-a4231235ade6 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.218939 Sep 01 17:43:43.056873 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 441/922] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:42 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:43:43.113256 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-b5ae1357-d97b-48b7-b579-fc272abaccbe req-fe9288a7-6c10-478f-aceb-ef553e8722c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3623a32e-47b4-43dc-a80b-ca4254f4eaa5", "name": "network-vif-plugged", "status": "completed", "tag": "67cfe8a5-3543-438d-a85f-436e1ad2ec3b"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:43.123966 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-b5ae1357-d97b-48b7-b579-fc272abaccbe req-fe9288a7-6c10-478f-aceb-ef553e8722c6 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:43.124457 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-b5ae1357-d97b-48b7-b579-fc272abaccbe req-fe9288a7-6c10-478f-aceb-ef553e8722c6 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:43.125196 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-b5ae1357-d97b-48b7-b579-fc272abaccbe req-fe9288a7-6c10-478f-aceb-ef553e8722c6 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:43.138416 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-b5ae1357-d97b-48b7-b579-fc272abaccbe req-fe9288a7-6c10-478f-aceb-ef553e8722c6 service nova] Creating event network-vif-plugged:67cfe8a5-3543-438d-a85f-436e1ad2ec3b for instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 on hv-cinder-83976 Sep 01 17:43:43.144392 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-b5ae1357-d97b-48b7-b579-fc272abaccbe req-fe9288a7-6c10-478f-aceb-ef553e8722c6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035841 Sep 01 17:43:43.145315 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 482/923] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:44.082769 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8dac1ecc-0410-4d8b-b054-a72c2a0f166e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:44.083422 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8dac1ecc-0410-4d8b-b054-a72c2a0f166e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:44.090303 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8dac1ecc-0410-4d8b-b054-a72c2a0f166e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:44.090790 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8dac1ecc-0410-4d8b-b054-a72c2a0f166e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:44.091229 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8dac1ecc-0410-4d8b-b054-a72c2a0f166e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:44.091939 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8dac1ecc-0410-4d8b-b054-a72c2a0f166e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:44.092388 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8dac1ecc-0410-4d8b-b054-a72c2a0f166e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:44.092814 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8dac1ecc-0410-4d8b-b054-a72c2a0f166e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:44.256338 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8dac1ecc-0410-4d8b-b054-a72c2a0f166e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:44.264725 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8dac1ecc-0410-4d8b-b054-a72c2a0f166e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:44.266255 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8dac1ecc-0410-4d8b-b054-a72c2a0f166e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:44.267577 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8dac1ecc-0410-4d8b-b054-a72c2a0f166e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.189952 Sep 01 17:43:44.268752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 442/924] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:44 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:43:45.293118 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e3ec8089-0bf8-4fbb-b8bf-4bb776e05ea8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:45.293868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e3ec8089-0bf8-4fbb-b8bf-4bb776e05ea8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:45.300509 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3ec8089-0bf8-4fbb-b8bf-4bb776e05ea8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:45.301125 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3ec8089-0bf8-4fbb-b8bf-4bb776e05ea8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:45.301563 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3ec8089-0bf8-4fbb-b8bf-4bb776e05ea8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:45.302300 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3ec8089-0bf8-4fbb-b8bf-4bb776e05ea8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:45.302763 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3ec8089-0bf8-4fbb-b8bf-4bb776e05ea8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:45.303175 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e3ec8089-0bf8-4fbb-b8bf-4bb776e05ea8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:45.449827 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e3ec8089-0bf8-4fbb-b8bf-4bb776e05ea8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:45.460772 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e3ec8089-0bf8-4fbb-b8bf-4bb776e05ea8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:45.462279 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e3ec8089-0bf8-4fbb-b8bf-4bb776e05ea8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:45.463525 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e3ec8089-0bf8-4fbb-b8bf-4bb776e05ea8 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1734 microversion: 2.20 time: 0.175570 Sep 01 17:43:45.464207 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 483/925] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:45 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:46.490261 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a793b628-fc7f-489a-b19e-70833eb2e8bc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:46.491160 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a793b628-fc7f-489a-b19e-70833eb2e8bc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:46.497709 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a793b628-fc7f-489a-b19e-70833eb2e8bc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:46.498454 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a793b628-fc7f-489a-b19e-70833eb2e8bc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:46.498970 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a793b628-fc7f-489a-b19e-70833eb2e8bc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:46.499793 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a793b628-fc7f-489a-b19e-70833eb2e8bc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:46.500323 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a793b628-fc7f-489a-b19e-70833eb2e8bc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:46.500844 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a793b628-fc7f-489a-b19e-70833eb2e8bc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:46.601322 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-db64bb73-5f91-478f-8986-318eb28adfd4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:46.608635 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-db64bb73-5f91-478f-8986-318eb28adfd4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:46.609120 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-db64bb73-5f91-478f-8986-318eb28adfd4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:46.609639 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-db64bb73-5f91-478f-8986-318eb28adfd4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:46.640096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a793b628-fc7f-489a-b19e-70833eb2e8bc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:46.648865 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a793b628-fc7f-489a-b19e-70833eb2e8bc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:46.650354 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a793b628-fc7f-489a-b19e-70833eb2e8bc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:46.651517 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a793b628-fc7f-489a-b19e-70833eb2e8bc tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1721 microversion: 2.20 time: 0.167614 Sep 01 17:43:46.652063 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 443/926] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:46 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:46.673539 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-db64bb73-5f91-478f-8986-318eb28adfd4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Going to try to stop instance {{(pid=127233) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 17:43:46.718170 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-db64bb73-5f91-478f-8986-318eb28adfd4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "POST /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/action" status: 202 len: 0 microversion: 2.1 time: 0.120943 Sep 01 17:43:46.718795 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 484/927] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:43:46 2022] POST /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 17:43:46.728219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5ec4473f-12b0-471f-aa9d-feb4715c14e7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:46.728742 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5ec4473f-12b0-471f-aa9d-feb4715c14e7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:46.735047 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5ec4473f-12b0-471f-aa9d-feb4715c14e7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:46.735558 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5ec4473f-12b0-471f-aa9d-feb4715c14e7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:46.736013 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5ec4473f-12b0-471f-aa9d-feb4715c14e7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:46.736761 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5ec4473f-12b0-471f-aa9d-feb4715c14e7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:46.737484 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5ec4473f-12b0-471f-aa9d-feb4715c14e7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:46.738076 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5ec4473f-12b0-471f-aa9d-feb4715c14e7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:46.754843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=100 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:46.880899 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5ec4473f-12b0-471f-aa9d-feb4715c14e7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:46.889457 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5ec4473f-12b0-471f-aa9d-feb4715c14e7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1726 microversion: 2.1 time: 0.165302 Sep 01 17:43:46.889457 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 444/928] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:46 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:47.913155 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d8cab4c9-73f9-4dc4-a0db-540bab4289c0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:47.913845 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d8cab4c9-73f9-4dc4-a0db-540bab4289c0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:47.920757 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d8cab4c9-73f9-4dc4-a0db-540bab4289c0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:47.921311 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d8cab4c9-73f9-4dc4-a0db-540bab4289c0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:47.921780 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d8cab4c9-73f9-4dc4-a0db-540bab4289c0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:47.922518 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d8cab4c9-73f9-4dc4-a0db-540bab4289c0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:47.922965 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d8cab4c9-73f9-4dc4-a0db-540bab4289c0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:47.923385 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d8cab4c9-73f9-4dc4-a0db-540bab4289c0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:48.059879 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-d8cab4c9-73f9-4dc4-a0db-540bab4289c0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:48.071236 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d8cab4c9-73f9-4dc4-a0db-540bab4289c0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1726 microversion: 2.1 time: 0.163461 Sep 01 17:43:48.071825 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 485/929] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:47 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:43:49.092789 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-2420a688-bb81-4f18-8290-3d342d6c8c9a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:49.093405 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-2420a688-bb81-4f18-8290-3d342d6c8c9a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:49.100783 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2420a688-bb81-4f18-8290-3d342d6c8c9a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:49.101286 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2420a688-bb81-4f18-8290-3d342d6c8c9a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:49.101842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2420a688-bb81-4f18-8290-3d342d6c8c9a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:49.102494 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2420a688-bb81-4f18-8290-3d342d6c8c9a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:49.102922 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2420a688-bb81-4f18-8290-3d342d6c8c9a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:49.103803 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-2420a688-bb81-4f18-8290-3d342d6c8c9a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:49.246576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-2420a688-bb81-4f18-8290-3d342d6c8c9a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:49.255564 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-2420a688-bb81-4f18-8290-3d342d6c8c9a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1726 microversion: 2.1 time: 0.166824 Sep 01 17:43:49.256134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 445/930] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:49 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:43:50.276429 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-9851f96b-6906-4d9f-886d-bd147ba4f20e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:50.277051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-9851f96b-6906-4d9f-886d-bd147ba4f20e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:50.283536 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9851f96b-6906-4d9f-886d-bd147ba4f20e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:50.284022 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9851f96b-6906-4d9f-886d-bd147ba4f20e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:50.285115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9851f96b-6906-4d9f-886d-bd147ba4f20e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:50.285891 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9851f96b-6906-4d9f-886d-bd147ba4f20e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:50.286350 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9851f96b-6906-4d9f-886d-bd147ba4f20e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:50.286778 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9851f96b-6906-4d9f-886d-bd147ba4f20e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:50.421300 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-9851f96b-6906-4d9f-886d-bd147ba4f20e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:50.430542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-9851f96b-6906-4d9f-886d-bd147ba4f20e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1726 microversion: 2.1 time: 0.157984 Sep 01 17:43:50.431148 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 486/931] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:50 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:51.454932 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-893fc44a-b569-4d7d-b8af-2186ffa1a5a7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:51.454932 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-893fc44a-b569-4d7d-b8af-2186ffa1a5a7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:51.462587 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-893fc44a-b569-4d7d-b8af-2186ffa1a5a7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:51.463064 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-893fc44a-b569-4d7d-b8af-2186ffa1a5a7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:51.463498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-893fc44a-b569-4d7d-b8af-2186ffa1a5a7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:51.464273 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-893fc44a-b569-4d7d-b8af-2186ffa1a5a7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:51.464728 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-893fc44a-b569-4d7d-b8af-2186ffa1a5a7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:51.465152 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-893fc44a-b569-4d7d-b8af-2186ffa1a5a7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:51.608860 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-893fc44a-b569-4d7d-b8af-2186ffa1a5a7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:51.617400 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-893fc44a-b569-4d7d-b8af-2186ffa1a5a7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1726 microversion: 2.1 time: 0.167328 Sep 01 17:43:51.618005 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 446/932] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:51 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:52.639257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2e379c16-653c-40ae-a93f-3ef2e08ed850 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:52.639884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2e379c16-653c-40ae-a93f-3ef2e08ed850 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:52.647176 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e379c16-653c-40ae-a93f-3ef2e08ed850 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:52.647658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e379c16-653c-40ae-a93f-3ef2e08ed850 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:52.648089 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e379c16-653c-40ae-a93f-3ef2e08ed850 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:52.648787 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e379c16-653c-40ae-a93f-3ef2e08ed850 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:52.649229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e379c16-653c-40ae-a93f-3ef2e08ed850 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:52.649785 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e379c16-653c-40ae-a93f-3ef2e08ed850 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:52.792802 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2e379c16-653c-40ae-a93f-3ef2e08ed850 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:52.801531 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2e379c16-653c-40ae-a93f-3ef2e08ed850 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1726 microversion: 2.1 time: 0.166366 Sep 01 17:43:52.802178 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 487/933] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:52 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:53.822929 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-aee18d23-752b-4703-a8c4-efb10c5ee8ff tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:53.823557 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-aee18d23-752b-4703-a8c4-efb10c5ee8ff tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:53.826140 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:53.831357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aee18d23-752b-4703-a8c4-efb10c5ee8ff tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:53.831989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aee18d23-752b-4703-a8c4-efb10c5ee8ff tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:53.832436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aee18d23-752b-4703-a8c4-efb10c5ee8ff tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:53.833136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aee18d23-752b-4703-a8c4-efb10c5ee8ff tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:53.833595 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aee18d23-752b-4703-a8c4-efb10c5ee8ff tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:53.834030 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-aee18d23-752b-4703-a8c4-efb10c5ee8ff tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:53.973320 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-aee18d23-752b-4703-a8c4-efb10c5ee8ff tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:53.981876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-aee18d23-752b-4703-a8c4-efb10c5ee8ff tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1726 microversion: 2.1 time: 0.162864 Sep 01 17:43:53.982452 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 447/934] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:53 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:55.003879 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-9fe35eb8-f6e4-457a-83d3-dd1830ddb0d3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:55.004891 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-9fe35eb8-f6e4-457a-83d3-dd1830ddb0d3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:55.011031 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9fe35eb8-f6e4-457a-83d3-dd1830ddb0d3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:55.011495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9fe35eb8-f6e4-457a-83d3-dd1830ddb0d3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:55.011931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9fe35eb8-f6e4-457a-83d3-dd1830ddb0d3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:55.012636 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9fe35eb8-f6e4-457a-83d3-dd1830ddb0d3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:55.013093 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9fe35eb8-f6e4-457a-83d3-dd1830ddb0d3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:55.013517 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9fe35eb8-f6e4-457a-83d3-dd1830ddb0d3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:55.154593 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-9fe35eb8-f6e4-457a-83d3-dd1830ddb0d3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:55.163193 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-9fe35eb8-f6e4-457a-83d3-dd1830ddb0d3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1726 microversion: 2.1 time: 0.163338 Sep 01 17:43:55.163769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 488/935] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:54 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:56.185151 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9372c574-320a-49fb-81ee-bb303900d58d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:56.185790 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9372c574-320a-49fb-81ee-bb303900d58d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:56.192816 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9372c574-320a-49fb-81ee-bb303900d58d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:56.193301 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9372c574-320a-49fb-81ee-bb303900d58d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:56.193784 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9372c574-320a-49fb-81ee-bb303900d58d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:56.194489 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9372c574-320a-49fb-81ee-bb303900d58d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:56.194966 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9372c574-320a-49fb-81ee-bb303900d58d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:56.195393 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9372c574-320a-49fb-81ee-bb303900d58d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:56.330541 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9372c574-320a-49fb-81ee-bb303900d58d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:56.339079 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9372c574-320a-49fb-81ee-bb303900d58d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1726 microversion: 2.1 time: 0.157797 Sep 01 17:43:56.339644 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 448/936] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:56 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:57.360596 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-13594a2b-8eb5-4450-9f8c-642f8a68a6b4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:57.361215 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-13594a2b-8eb5-4450-9f8c-642f8a68a6b4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:57.368890 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-13594a2b-8eb5-4450-9f8c-642f8a68a6b4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:57.369371 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-13594a2b-8eb5-4450-9f8c-642f8a68a6b4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:57.369832 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-13594a2b-8eb5-4450-9f8c-642f8a68a6b4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:57.370531 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-13594a2b-8eb5-4450-9f8c-642f8a68a6b4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:57.370978 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-13594a2b-8eb5-4450-9f8c-642f8a68a6b4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:57.371394 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-13594a2b-8eb5-4450-9f8c-642f8a68a6b4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:57.511140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-13594a2b-8eb5-4450-9f8c-642f8a68a6b4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:57.519891 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-13594a2b-8eb5-4450-9f8c-642f8a68a6b4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1726 microversion: 2.1 time: 0.162956 Sep 01 17:43:57.520608 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 489/937] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:57 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:58.541268 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-68e682f0-6794-4c8e-ba52-97bfd271d9b7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:58.541855 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-68e682f0-6794-4c8e-ba52-97bfd271d9b7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:58.548523 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68e682f0-6794-4c8e-ba52-97bfd271d9b7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:58.548998 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68e682f0-6794-4c8e-ba52-97bfd271d9b7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:58.549429 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68e682f0-6794-4c8e-ba52-97bfd271d9b7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:58.550151 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68e682f0-6794-4c8e-ba52-97bfd271d9b7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:58.550672 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68e682f0-6794-4c8e-ba52-97bfd271d9b7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:58.551189 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-68e682f0-6794-4c8e-ba52-97bfd271d9b7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:58.695491 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-68e682f0-6794-4c8e-ba52-97bfd271d9b7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:58.703953 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-68e682f0-6794-4c8e-ba52-97bfd271d9b7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1726 microversion: 2.1 time: 0.166899 Sep 01 17:43:58.704517 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 449/938] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:58 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:59.727743 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-326eafdc-6115-4dae-9ade-cbfeb725ab96 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:59.728364 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-326eafdc-6115-4dae-9ade-cbfeb725ab96 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:59.735438 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-326eafdc-6115-4dae-9ade-cbfeb725ab96 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:59.735955 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-326eafdc-6115-4dae-9ade-cbfeb725ab96 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:59.736406 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-326eafdc-6115-4dae-9ade-cbfeb725ab96 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:59.737157 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-326eafdc-6115-4dae-9ade-cbfeb725ab96 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:59.737656 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-326eafdc-6115-4dae-9ade-cbfeb725ab96 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:59.738881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-326eafdc-6115-4dae-9ade-cbfeb725ab96 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:59.881627 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-326eafdc-6115-4dae-9ade-cbfeb725ab96 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:59.890255 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-326eafdc-6115-4dae-9ade-cbfeb725ab96 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1726 microversion: 2.1 time: 0.166653 Sep 01 17:43:59.890848 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 490/939] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:59 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:00.074370 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3c3bd363-8931-4289-afc7-9fd722cc0a6e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:00.074905 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3c3bd363-8931-4289-afc7-9fd722cc0a6e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:00.076760 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-c6c4c8c5-cb7a-4c60-9949-aad55247b30a req-69f33157-17a9-4e16-ba35-7d6c5bc788a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14547422-6c4f-4c71-8cf7-eaa09e5f52b0", "tag": "a58ebdf5-88c8-48f6-b574-774858b2603f"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:00.082727 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3c3bd363-8931-4289-afc7-9fd722cc0a6e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:00.083593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3c3bd363-8931-4289-afc7-9fd722cc0a6e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:00.084016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3c3bd363-8931-4289-afc7-9fd722cc0a6e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:00.084730 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3c3bd363-8931-4289-afc7-9fd722cc0a6e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:00.085485 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3c3bd363-8931-4289-afc7-9fd722cc0a6e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:00.086172 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3c3bd363-8931-4289-afc7-9fd722cc0a6e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:00.087430 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-c6c4c8c5-cb7a-4c60-9949-aad55247b30a req-69f33157-17a9-4e16-ba35-7d6c5bc788a1 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:00.087902 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-c6c4c8c5-cb7a-4c60-9949-aad55247b30a req-69f33157-17a9-4e16-ba35-7d6c5bc788a1 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:00.088396 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-c6c4c8c5-cb7a-4c60-9949-aad55247b30a req-69f33157-17a9-4e16-ba35-7d6c5bc788a1 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:00.101411 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-c6c4c8c5-cb7a-4c60-9949-aad55247b30a req-69f33157-17a9-4e16-ba35-7d6c5bc788a1 service nova] Creating event network-changed:a58ebdf5-88c8-48f6-b574-774858b2603f for instance 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 on hv-cinder-83976 Sep 01 17:44:00.109521 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-c6c4c8c5-cb7a-4c60-9949-aad55247b30a req-69f33157-17a9-4e16-ba35-7d6c5bc788a1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036260 Sep 01 17:44:00.110548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 491/940] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:00.120226 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3c3bd363-8931-4289-afc7-9fd722cc0a6e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Going to try to terminate instance {{(pid=127232) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:44:00.233438 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-3c3bd363-8931-4289-afc7-9fd722cc0a6e tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "DELETE /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 204 len: 0 microversion: 2.1 time: 0.162602 Sep 01 17:44:00.237563 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 450/941] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:44:00 2022] DELETE /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:00.243513 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c0fce6d2-4218-441d-bec0-67d736b46fed tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:00.244333 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c0fce6d2-4218-441d-bec0-67d736b46fed tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:00.255975 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c0fce6d2-4218-441d-bec0-67d736b46fed tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:00.257120 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c0fce6d2-4218-441d-bec0-67d736b46fed tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:00.257908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c0fce6d2-4218-441d-bec0-67d736b46fed tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:00.258801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c0fce6d2-4218-441d-bec0-67d736b46fed tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:00.259333 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c0fce6d2-4218-441d-bec0-67d736b46fed tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:00.259981 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c0fce6d2-4218-441d-bec0-67d736b46fed tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:00.508069 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c0fce6d2-4218-441d-bec0-67d736b46fed tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:00.516684 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-c0fce6d2-4218-441d-bec0-67d736b46fed tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.277343 Sep 01 17:44:00.517558 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 492/942] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:00 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:00.912680 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-dd258612-cc78-448e-bf8c-63f9392d8499 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:00.913377 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-dd258612-cc78-448e-bf8c-63f9392d8499 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:00.919690 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dd258612-cc78-448e-bf8c-63f9392d8499 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:00.920174 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dd258612-cc78-448e-bf8c-63f9392d8499 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:00.920617 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dd258612-cc78-448e-bf8c-63f9392d8499 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:00.921414 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dd258612-cc78-448e-bf8c-63f9392d8499 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:00.921787 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dd258612-cc78-448e-bf8c-63f9392d8499 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:00.922215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dd258612-cc78-448e-bf8c-63f9392d8499 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:01.068419 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-dd258612-cc78-448e-bf8c-63f9392d8499 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:01.077184 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-dd258612-cc78-448e-bf8c-63f9392d8499 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1726 microversion: 2.1 time: 0.168798 Sep 01 17:44:01.078209 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 451/943] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:00 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:01.538660 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-632a3a8f-71a4-4134-be3d-25285816ec6d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:01.539285 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-632a3a8f-71a4-4134-be3d-25285816ec6d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:01.546257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-632a3a8f-71a4-4134-be3d-25285816ec6d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:01.546749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-632a3a8f-71a4-4134-be3d-25285816ec6d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:01.547188 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-632a3a8f-71a4-4134-be3d-25285816ec6d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:01.548104 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-632a3a8f-71a4-4134-be3d-25285816ec6d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:01.548572 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-632a3a8f-71a4-4134-be3d-25285816ec6d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:01.548997 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-632a3a8f-71a4-4134-be3d-25285816ec6d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:01.757509 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-632a3a8f-71a4-4134-be3d-25285816ec6d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:01.766427 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-632a3a8f-71a4-4134-be3d-25285816ec6d tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1568 microversion: 2.1 time: 0.231628 Sep 01 17:44:01.767038 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 493/944] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:01 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:02.103196 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8ae42be7-a740-4260-b531-e6be8ade877d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:02.104696 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8ae42be7-a740-4260-b531-e6be8ade877d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:02.111484 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ae42be7-a740-4260-b531-e6be8ade877d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.111980 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ae42be7-a740-4260-b531-e6be8ade877d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.112420 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ae42be7-a740-4260-b531-e6be8ade877d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.113900 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ae42be7-a740-4260-b531-e6be8ade877d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.114473 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ae42be7-a740-4260-b531-e6be8ade877d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.114911 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8ae42be7-a740-4260-b531-e6be8ade877d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.255841 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8ae42be7-a740-4260-b531-e6be8ade877d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:02.264248 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8ae42be7-a740-4260-b531-e6be8ade877d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1703 microversion: 2.1 time: 0.165202 Sep 01 17:44:02.264993 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 452/945] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:02 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1703 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:02.285227 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-bef9a8ba-b5e9-4e3c-854f-f71ae9cea91b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:02.292212 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bef9a8ba-b5e9-4e3c-854f-f71ae9cea91b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.292781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bef9a8ba-b5e9-4e3c-854f-f71ae9cea91b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.293442 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bef9a8ba-b5e9-4e3c-854f-f71ae9cea91b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.311805 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:02.319540 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-bef9a8ba-b5e9-4e3c-854f-f71ae9cea91b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Going to try to start instance {{(pid=127233) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 17:44:02.367621 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-bef9a8ba-b5e9-4e3c-854f-f71ae9cea91b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "POST /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/action" status: 202 len: 0 microversion: 2.1 time: 0.086098 Sep 01 17:44:02.368129 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 494/946] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:44:02 2022] POST /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:44:02.376805 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a90c8da5-58e4-452c-b92b-4552cba994f3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:02.377414 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a90c8da5-58e4-452c-b92b-4552cba994f3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:02.384475 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a90c8da5-58e4-452c-b92b-4552cba994f3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.385271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a90c8da5-58e4-452c-b92b-4552cba994f3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.385984 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a90c8da5-58e4-452c-b92b-4552cba994f3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.386732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a90c8da5-58e4-452c-b92b-4552cba994f3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.387339 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a90c8da5-58e4-452c-b92b-4552cba994f3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.387931 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a90c8da5-58e4-452c-b92b-4552cba994f3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.523717 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-fec38b13-9d98-4bd7-a8ea-4983914cdd13 req-4cf5db41-fc6a-4240-a00d-3f0b9d98d73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14547422-6c4f-4c71-8cf7-eaa09e5f52b0", "name": "network-vif-deleted", "tag": "a58ebdf5-88c8-48f6-b574-774858b2603f"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:02.537459 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-fec38b13-9d98-4bd7-a8ea-4983914cdd13 req-4cf5db41-fc6a-4240-a00d-3f0b9d98d73f service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.538077 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-fec38b13-9d98-4bd7-a8ea-4983914cdd13 req-4cf5db41-fc6a-4240-a00d-3f0b9d98d73f service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.538770 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-fec38b13-9d98-4bd7-a8ea-4983914cdd13 req-4cf5db41-fc6a-4240-a00d-3f0b9d98d73f service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.553658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-fec38b13-9d98-4bd7-a8ea-4983914cdd13 req-4cf5db41-fc6a-4240-a00d-3f0b9d98d73f service nova] Creating event network-vif-deleted:a58ebdf5-88c8-48f6-b574-774858b2603f for instance 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 on hv-cinder-83976 Sep 01 17:44:02.559584 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-fec38b13-9d98-4bd7-a8ea-4983914cdd13 req-4cf5db41-fc6a-4240-a00d-3f0b9d98d73f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042073 Sep 01 17:44:02.560296 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 495/947] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:02.577931 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a90c8da5-58e4-452c-b92b-4552cba994f3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:02.588235 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a90c8da5-58e4-452c-b92b-4552cba994f3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1712 microversion: 2.1 time: 0.214816 Sep 01 17:44:02.602915 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 453/948] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:02 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1712 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:44:02.787845 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-bd2d6983-d511-4773-a203-9b1dde5c619c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:02.788612 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-bd2d6983-d511-4773-a203-9b1dde5c619c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:02.796640 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd2d6983-d511-4773-a203-9b1dde5c619c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.797365 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd2d6983-d511-4773-a203-9b1dde5c619c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.797976 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd2d6983-d511-4773-a203-9b1dde5c619c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.798859 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd2d6983-d511-4773-a203-9b1dde5c619c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.799869 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd2d6983-d511-4773-a203-9b1dde5c619c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.800636 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd2d6983-d511-4773-a203-9b1dde5c619c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.890169 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-bd2d6983-d511-4773-a203-9b1dde5c619c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289058107592455fbf5af315fba7a126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f3bf24fbbd42919ad87cc04e4f6042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:02.899535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-bd2d6983-d511-4773-a203-9b1dde5c619c tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 200 len: 1221 microversion: 2.1 time: 0.115880 Sep 01 17:44:02.900363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 496/949] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:02 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 1221 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:03.611725 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4f2f8f7a-708b-4646-b738-f59b099852fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:03.617161 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4f2f8f7a-708b-4646-b738-f59b099852fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:03.624076 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f2f8f7a-708b-4646-b738-f59b099852fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:03.624868 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f2f8f7a-708b-4646-b738-f59b099852fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:03.625512 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f2f8f7a-708b-4646-b738-f59b099852fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:03.627074 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f2f8f7a-708b-4646-b738-f59b099852fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:03.627870 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f2f8f7a-708b-4646-b738-f59b099852fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:03.629477 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f2f8f7a-708b-4646-b738-f59b099852fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:03.778490 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4f2f8f7a-708b-4646-b738-f59b099852fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:03.787558 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4f2f8f7a-708b-4646-b738-f59b099852fb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1712 microversion: 2.1 time: 0.180488 Sep 01 17:44:03.788126 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 454/950] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:03 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1712 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:03.921607 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2e8a7778-520d-4a57-8633-2fa237a3b950 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:03.922163 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2e8a7778-520d-4a57-8633-2fa237a3b950 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] [instance: 14547422-6c4f-4c71-8cf7-eaa09e5f52b0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:03.928574 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e8a7778-520d-4a57-8633-2fa237a3b950 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:03.929083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e8a7778-520d-4a57-8633-2fa237a3b950 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:03.929520 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e8a7778-520d-4a57-8633-2fa237a3b950 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:03.930244 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e8a7778-520d-4a57-8633-2fa237a3b950 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:03.930698 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e8a7778-520d-4a57-8633-2fa237a3b950 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:03.931122 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2e8a7778-520d-4a57-8633-2fa237a3b950 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:03.944322 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-2e8a7778-520d-4a57-8633-2fa237a3b950 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] HTTP exception thrown: Instance 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 could not be found. Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2e8a7778-520d-4a57-8633-2fa237a3b950 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Request method failure captured: Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 HTTP/1.1 Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO4h18OO0CNXA-DSrAYVoOncciRQ8SVFy6RXfsdnjcJhtqwWCJwlg2hz7TgR3MBkJ8SpXG8HAA3x3Hb3LQg82l5usOS11axbJld0BTApytDT1HdOfMXF9nemTCh5BE2UUV3uP8Q9dqyi5e7p8zMIpEM7EOE-IFKlGg06ktyU1Xtrsxs Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: b3f3bf24fbbd42919ad87cc04e4f6042 Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-TestShelveInstance-886876416 Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:44:03.946004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:44:03.947647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b3f3bf24fbbd42919ad87cc04e4f6042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b3f3bf24fbbd42919ad87cc04e4f6042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b3f3bf24fbbd42919ad87cc04e4f6042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b3f3bf24fbbd42919ad87cc04e4f6042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:03.947647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-TestShelveInstance-886876416 Sep 01 17:44:03.947647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: b3f3bf24fbbd42919ad87cc04e4f6042 Sep 01 17:44:03.947647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-TestShelveInstance-886876416 Sep 01 17:44:03.947647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-TestShelveInstance-886876416-project Sep 01 17:44:03.947647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:44:03.947647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:44:03.947647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: 289058107592455fbf5af315fba7a126 Sep 01 17:44:03.947647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-TestShelveInstance-886876416-project Sep 01 17:44:03.947647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:44:03.947647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 could not be found. Sep 01 17:44:03.947647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '14547422-6c4f-4c71-8cf7-eaa09e5f52b0'} Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 could not be found. Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:03.948632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 could not be found. Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 could not be found. Sep 01 17:44:03.950262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:03.951787 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2e8a7778-520d-4a57-8633-2fa237a3b950 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Returning 404 to user: Instance 14547422-6c4f-4c71-8cf7-eaa09e5f52b0 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:03.951787 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2e8a7778-520d-4a57-8633-2fa237a3b950 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0" status: 404 len: 111 microversion: 2.1 time: 0.029759 Sep 01 17:44:03.951787 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 497/951] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:03 2022] GET /compute/v2.1/servers/14547422-6c4f-4c71-8cf7-eaa09e5f52b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:44:04.115294 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-7e0f69f3-b355-4028-9ed6-6981442b68d5 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] Calling method '.version_select at 0x7f354deff940>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:04.136394 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-7e0f69f3-b355-4028-9ed6-6981442b68d5 tempest-TestShelveInstance-886876416 tempest-TestShelveInstance-886876416-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-41354798" status: 202 len: 0 microversion: 2.1 time: 0.025767 Sep 01 17:44:04.137547 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 455/952] 10.222.0.100 () {58 vars in 1253 bytes} [Thu Sep 1 17:44:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-41354798 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:44:04.809183 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1501d81c-e67a-4c0d-a53c-9c36ac63e2f7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:04.809726 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-1501d81c-e67a-4c0d-a53c-9c36ac63e2f7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:04.815622 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1501d81c-e67a-4c0d-a53c-9c36ac63e2f7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:04.816216 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1501d81c-e67a-4c0d-a53c-9c36ac63e2f7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:04.816658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1501d81c-e67a-4c0d-a53c-9c36ac63e2f7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:04.817343 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1501d81c-e67a-4c0d-a53c-9c36ac63e2f7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:04.817843 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1501d81c-e67a-4c0d-a53c-9c36ac63e2f7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:04.818267 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1501d81c-e67a-4c0d-a53c-9c36ac63e2f7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:04.957197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-1501d81c-e67a-4c0d-a53c-9c36ac63e2f7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:04.965857 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1501d81c-e67a-4c0d-a53c-9c36ac63e2f7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1716 microversion: 2.1 time: 0.160936 Sep 01 17:44:04.966680 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 498/953] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:04 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:19.128164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8a0e284a-349b-430a-9e7c-845b7c88bc38 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:19.128759 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8a0e284a-349b-430a-9e7c-845b7c88bc38 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:19.131493 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:19.132252 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:19.139124 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8a0e284a-349b-430a-9e7c-845b7c88bc38 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:19.139603 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8a0e284a-349b-430a-9e7c-845b7c88bc38 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:19.140032 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8a0e284a-349b-430a-9e7c-845b7c88bc38 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:19.140855 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8a0e284a-349b-430a-9e7c-845b7c88bc38 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:19.141311 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8a0e284a-349b-430a-9e7c-845b7c88bc38 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:19.141763 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8a0e284a-349b-430a-9e7c-845b7c88bc38 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:19.169093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8a0e284a-349b-430a-9e7c-845b7c88bc38 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700/ips" status: 200 len: 149 microversion: 2.1 time: 0.044890 Sep 01 17:44:19.169669 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 456/954] 10.222.0.100 () {58 vars in 1253 bytes} [Thu Sep 1 17:44:19 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:19.386380 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1d151037-a90f-4c65-8705-f1eda0f4e50c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:19.388579 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-1d151037-a90f-4c65-8705-f1eda0f4e50c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:19.390839 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=37 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:19.391488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:19.397189 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1d151037-a90f-4c65-8705-f1eda0f4e50c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:19.397808 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1d151037-a90f-4c65-8705-f1eda0f4e50c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:19.398136 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1d151037-a90f-4c65-8705-f1eda0f4e50c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:19.398893 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1d151037-a90f-4c65-8705-f1eda0f4e50c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:19.399348 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1d151037-a90f-4c65-8705-f1eda0f4e50c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:19.399771 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1d151037-a90f-4c65-8705-f1eda0f4e50c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:19.435115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1d151037-a90f-4c65-8705-f1eda0f4e50c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052749 Sep 01 17:44:19.436131 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 499/955] 10.222.0.100 () {60 vars in 1348 bytes} [Thu Sep 1 17:44:19 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:19.514272 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-770f1a8c-c7f4-4609-a74b-664c7458b20f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:19.514791 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-770f1a8c-c7f4-4609-a74b-664c7458b20f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:19.521538 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-770f1a8c-c7f4-4609-a74b-664c7458b20f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:19.522047 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-770f1a8c-c7f4-4609-a74b-664c7458b20f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:19.522484 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-770f1a8c-c7f4-4609-a74b-664c7458b20f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:19.523179 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-770f1a8c-c7f4-4609-a74b-664c7458b20f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:19.523631 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-770f1a8c-c7f4-4609-a74b-664c7458b20f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:19.524270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-770f1a8c-c7f4-4609-a74b-664c7458b20f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:19.551054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-770f1a8c-c7f4-4609-a74b-664c7458b20f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Going to try to terminate instance {{(pid=127232) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:44:19.628915 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-770f1a8c-c7f4-4609-a74b-664c7458b20f tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "DELETE /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 204 len: 0 microversion: 2.20 time: 0.118515 Sep 01 17:44:19.629556 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 457/956] 10.222.0.100 () {60 vars in 1285 bytes} [Thu Sep 1 17:44:19 2022] DELETE /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 17:44:19.638910 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-bd93d132-ce8c-458f-89f8-d1de33faa964 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:19.639494 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-bd93d132-ce8c-458f-89f8-d1de33faa964 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:19.646271 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd93d132-ce8c-458f-89f8-d1de33faa964 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:19.646778 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd93d132-ce8c-458f-89f8-d1de33faa964 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:19.647237 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd93d132-ce8c-458f-89f8-d1de33faa964 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:19.647944 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd93d132-ce8c-458f-89f8-d1de33faa964 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:19.648400 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd93d132-ce8c-458f-89f8-d1de33faa964 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:19.648887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bd93d132-ce8c-458f-89f8-d1de33faa964 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:19.783394 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-bd93d132-ce8c-458f-89f8-d1de33faa964 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:19.792759 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-bd93d132-ce8c-458f-89f8-d1de33faa964 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:19.794247 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-bd93d132-ce8c-458f-89f8-d1de33faa964 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:19.795406 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-bd93d132-ce8c-458f-89f8-d1de33faa964 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.161329 Sep 01 17:44:19.795965 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 500/957] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:44:19 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:44:20.542595 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-94f086f6-6b77-412f-a5d9-180397299012 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6e24f92-dc52-408a-995d-636aa3841666"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:20.545006 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-94f086f6-6b77-412f-a5d9-180397299012 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:20.552090 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-94f086f6-6b77-412f-a5d9-180397299012 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:20.552575 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-94f086f6-6b77-412f-a5d9-180397299012 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:20.553006 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-94f086f6-6b77-412f-a5d9-180397299012 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:20.553731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-94f086f6-6b77-412f-a5d9-180397299012 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:20.554185 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-94f086f6-6b77-412f-a5d9-180397299012 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:20.554607 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-94f086f6-6b77-412f-a5d9-180397299012 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:20.818602 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-fd3a5fca-337b-4ba5-8fda-d15e5f246e8e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:20.819184 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-fd3a5fca-337b-4ba5-8fda-d15e5f246e8e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:20.825915 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fd3a5fca-337b-4ba5-8fda-d15e5f246e8e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:20.826400 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fd3a5fca-337b-4ba5-8fda-d15e5f246e8e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:20.826839 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fd3a5fca-337b-4ba5-8fda-d15e5f246e8e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:20.827533 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fd3a5fca-337b-4ba5-8fda-d15e5f246e8e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:20.827989 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fd3a5fca-337b-4ba5-8fda-d15e5f246e8e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:20.828412 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-fd3a5fca-337b-4ba5-8fda-d15e5f246e8e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:20.975142 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-fd3a5fca-337b-4ba5-8fda-d15e5f246e8e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:20.984448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-fd3a5fca-337b-4ba5-8fda-d15e5f246e8e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:20.986279 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-fd3a5fca-337b-4ba5-8fda-d15e5f246e8e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:20.987486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-fd3a5fca-337b-4ba5-8fda-d15e5f246e8e tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1727 microversion: 2.20 time: 0.172896 Sep 01 17:44:20.988099 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 501/958] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:44:20 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:44:20.995864 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-94f086f6-6b77-412f-a5d9-180397299012 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "POST /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457675 Sep 01 17:44:20.996462 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 458/959] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:44:20 2022] POST /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700/os-volume_attachments => generated 194 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:22.012294 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e51f7b7f-7689-41d7-a2b4-28df56332eae tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:22.013515 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e51f7b7f-7689-41d7-a2b4-28df56332eae tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:22.014768 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-d4b89d1e-652a-48cf-9fab-fe00849c50c9 req-f856ed23-ab57-44ef-96ce-38ceca07d869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3623a32e-47b4-43dc-a80b-ca4254f4eaa5", "name": "network-vif-deleted", "tag": "67cfe8a5-3543-438d-a85f-436e1ad2ec3b"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:22.022551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e51f7b7f-7689-41d7-a2b4-28df56332eae tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:22.030150 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-d4b89d1e-652a-48cf-9fab-fe00849c50c9 req-f856ed23-ab57-44ef-96ce-38ceca07d869 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:22.030687 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-d4b89d1e-652a-48cf-9fab-fe00849c50c9 req-f856ed23-ab57-44ef-96ce-38ceca07d869 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:22.031052 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-d4b89d1e-652a-48cf-9fab-fe00849c50c9 req-f856ed23-ab57-44ef-96ce-38ceca07d869 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:22.032423 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e51f7b7f-7689-41d7-a2b4-28df56332eae tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:22.033169 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e51f7b7f-7689-41d7-a2b4-28df56332eae tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:22.033955 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e51f7b7f-7689-41d7-a2b4-28df56332eae tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:22.038088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e51f7b7f-7689-41d7-a2b4-28df56332eae tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:22.038540 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e51f7b7f-7689-41d7-a2b4-28df56332eae tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:22.047451 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-d4b89d1e-652a-48cf-9fab-fe00849c50c9 req-f856ed23-ab57-44ef-96ce-38ceca07d869 service nova] Creating event network-vif-deleted:67cfe8a5-3543-438d-a85f-436e1ad2ec3b for instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 on hv-cinder-83976 Sep 01 17:44:22.057071 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-d4b89d1e-652a-48cf-9fab-fe00849c50c9 req-f856ed23-ab57-44ef-96ce-38ceca07d869 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046515 Sep 01 17:44:22.058286 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 459/960] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:22.148444 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e51f7b7f-7689-41d7-a2b4-28df56332eae tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:22.158195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e51f7b7f-7689-41d7-a2b4-28df56332eae tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:22.159697 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e51f7b7f-7689-41d7-a2b4-28df56332eae tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcc538bc852f404699d91d17023ae620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b8d4a14a9460eb4ce9967f86e4757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:22.161162 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e51f7b7f-7689-41d7-a2b4-28df56332eae tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 200 len: 1369 microversion: 2.20 time: 0.152597 Sep 01 17:44:22.161772 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 502/961] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:44:22 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:44:23.185435 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-abcb84ed-6279-48ec-b8c4-59cbffe8bebb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:23.186162 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-abcb84ed-6279-48ec-b8c4-59cbffe8bebb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:23.194866 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-abcb84ed-6279-48ec-b8c4-59cbffe8bebb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:23.195122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-abcb84ed-6279-48ec-b8c4-59cbffe8bebb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:23.195559 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-abcb84ed-6279-48ec-b8c4-59cbffe8bebb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:23.196252 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-abcb84ed-6279-48ec-b8c4-59cbffe8bebb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:23.196701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-abcb84ed-6279-48ec-b8c4-59cbffe8bebb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:23.197120 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-abcb84ed-6279-48ec-b8c4-59cbffe8bebb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:23.211766 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-abcb84ed-6279-48ec-b8c4-59cbffe8bebb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] HTTP exception thrown: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-abcb84ed-6279-48ec-b8c4-59cbffe8bebb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Request method failure captured: Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 HTTP/1.1 Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO2ta67Nt658ECETsKDQS04ve5Vd2ka7ziEOrDDh7dgSRR_4b-zuSksHOlqvLrEhorWM1hSUE7fVgvXOh7amlHLg-PZnGTr65yzpjjpYuXpe7oHgqWCWlCBx5IFgj-nmVvTVG35MBSv921-bTQhUZQ6f28pEdb6Oq5cPSktLuvvxsmM Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: e11b8d4a14a9460eb4ce9967f86e4757 Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:44:23.213871 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:44:23.215646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:23.215646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:23.215646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: e11b8d4a14a9460eb4ce9967f86e4757 Sep 01 17:44:23.215646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:23.215646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-AttachVolumeShelveTestJSON-1402317429-project Sep 01 17:44:23.215646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:44:23.215646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:44:23.215646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: bcc538bc852f404699d91d17023ae620 Sep 01 17:44:23.215646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1402317429-project Sep 01 17:44:23.215646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:44:23.215646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:23.215646 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '3623a32e-47b4-43dc-a80b-ca4254f4eaa5'} Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:23.216572 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:23.218180 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:23.219555 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-abcb84ed-6279-48ec-b8c4-59cbffe8bebb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Returning 404 to user: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:23.219555 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-abcb84ed-6279-48ec-b8c4-59cbffe8bebb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 404 len: 111 microversion: 2.20 time: 0.035275 Sep 01 17:44:23.219555 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 460/962] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:44:23 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:44:23.225266 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-981312b6-e467-4048-9f58-513edef01886 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '.version_select at 0x7f354a68f940>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:23.245881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-981312b6-e467-4048-9f58-513edef01886 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807795194" status: 204 len: 0 microversion: 2.20 time: 0.024637 Sep 01 17:44:23.246453 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 503/963] 10.222.0.100 () {60 vars in 1264 bytes} [Thu Sep 1 17:44:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807795194 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 17:44:25.023291 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-fb5257f3-995a-47dc-8270-0b1fb983ed39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:25.023813 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-fb5257f3-995a-47dc-8270-0b1fb983ed39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:25.030126 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb5257f3-995a-47dc-8270-0b1fb983ed39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:25.030602 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb5257f3-995a-47dc-8270-0b1fb983ed39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:25.031032 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb5257f3-995a-47dc-8270-0b1fb983ed39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:25.031712 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb5257f3-995a-47dc-8270-0b1fb983ed39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:25.032157 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb5257f3-995a-47dc-8270-0b1fb983ed39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:25.032577 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fb5257f3-995a-47dc-8270-0b1fb983ed39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:25.046156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-fb5257f3-995a-47dc-8270-0b1fb983ed39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] HTTP exception thrown: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-fb5257f3-995a-47dc-8270-0b1fb983ed39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Request method failure captured: Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: DELETE /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 HTTP/1.1 Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO2ta67Nt658ECETsKDQS04ve5Vd2ka7ziEOrDDh7dgSRR_4b-zuSksHOlqvLrEhorWM1hSUE7fVgvXOh7amlHLg-PZnGTr65yzpjjpYuXpe7oHgqWCWlCBx5IFgj-nmVvTVG35MBSv921-bTQhUZQ6f28pEdb6Oq5cPSktLuvvxsmM Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: e11b8d4a14a9460eb4ce9967f86e4757 Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:44:25.047731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:44:25.051934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:25.051934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:25.051934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: e11b8d4a14a9460eb4ce9967f86e4757 Sep 01 17:44:25.051934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:25.051934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-AttachVolumeShelveTestJSON-1402317429-project Sep 01 17:44:25.051934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:44:25.051934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:44:25.051934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: bcc538bc852f404699d91d17023ae620 Sep 01 17:44:25.051934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1402317429-project Sep 01 17:44:25.051934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:44:25.051934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:25.051934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '3623a32e-47b4-43dc-a80b-ca4254f4eaa5'} Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:25.052822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:25.054317 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:25.055764 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-fb5257f3-995a-47dc-8270-0b1fb983ed39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Returning 404 to user: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:25.055764 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-fb5257f3-995a-47dc-8270-0b1fb983ed39 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "DELETE /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 404 len: 111 microversion: 2.20 time: 0.029831 Sep 01 17:44:25.055764 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 461/964] 10.222.0.100 () {60 vars in 1285 bytes} [Thu Sep 1 17:44:25 2022] DELETE /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:44:25.058955 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ac4ca468-91ca-43e5-850c-4ba20cc0326c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:25.059594 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ac4ca468-91ca-43e5-850c-4ba20cc0326c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 3623a32e-47b4-43dc-a80b-ca4254f4eaa5] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:25.066376 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ac4ca468-91ca-43e5-850c-4ba20cc0326c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:25.067634 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ac4ca468-91ca-43e5-850c-4ba20cc0326c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:25.068153 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ac4ca468-91ca-43e5-850c-4ba20cc0326c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:25.068873 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ac4ca468-91ca-43e5-850c-4ba20cc0326c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:25.069338 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ac4ca468-91ca-43e5-850c-4ba20cc0326c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:25.069804 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ac4ca468-91ca-43e5-850c-4ba20cc0326c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:25.083658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-ac4ca468-91ca-43e5-850c-4ba20cc0326c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] HTTP exception thrown: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ac4ca468-91ca-43e5-850c-4ba20cc0326c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Request method failure captured: Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 HTTP/1.1 Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2ta67Nt658ECETsKDQS04ve5Vd2ka7ziEOrDDh7dgSRR_4b-zuSksHOlqvLrEhorWM1hSUE7fVgvXOh7amlHLg-PZnGTr65yzpjjpYuXpe7oHgqWCWlCBx5IFgj-nmVvTVG35MBSv921-bTQhUZQ6f28pEdb6Oq5cPSktLuvvxsmM Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: e11b8d4a14a9460eb4ce9967f86e4757 Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:44:25.085229 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:44:25.086931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:25.086931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:25.086931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: e11b8d4a14a9460eb4ce9967f86e4757 Sep 01 17:44:25.086931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:25.086931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-AttachVolumeShelveTestJSON-1402317429-project Sep 01 17:44:25.086931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:44:25.086931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:44:25.086931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: bcc538bc852f404699d91d17023ae620 Sep 01 17:44:25.086931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1402317429-project Sep 01 17:44:25.086931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:44:25.086931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:25.086931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '3623a32e-47b4-43dc-a80b-ca4254f4eaa5'} Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:25.087669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. Sep 01 17:44:25.089094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:25.090286 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ac4ca468-91ca-43e5-850c-4ba20cc0326c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Returning 404 to user: Instance 3623a32e-47b4-43dc-a80b-ca4254f4eaa5 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:25.090286 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ac4ca468-91ca-43e5-850c-4ba20cc0326c tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5" status: 404 len: 111 microversion: 2.20 time: 0.032223 Sep 01 17:44:25.090286 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 504/965] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:44:25 2022] GET /compute/v2.1/servers/3623a32e-47b4-43dc-a80b-ca4254f4eaa5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:44:26.227951 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4eb88a32-bd02-491b-a225-ca1ea1277701 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:26.228483 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4eb88a32-bd02-491b-a225-ca1ea1277701 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:26.234992 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4eb88a32-bd02-491b-a225-ca1ea1277701 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:26.235432 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4eb88a32-bd02-491b-a225-ca1ea1277701 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:26.235867 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4eb88a32-bd02-491b-a225-ca1ea1277701 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:26.236553 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4eb88a32-bd02-491b-a225-ca1ea1277701 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:26.237001 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4eb88a32-bd02-491b-a225-ca1ea1277701 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:26.237431 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4eb88a32-bd02-491b-a225-ca1ea1277701 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:26.251999 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-4eb88a32-bd02-491b-a225-ca1ea1277701 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] HTTP exception thrown: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4eb88a32-bd02-491b-a225-ca1ea1277701 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Request method failure captured: Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: DELETE /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d HTTP/1.1 Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO2ta67Nt658ECETsKDQS04ve5Vd2ka7ziEOrDDh7dgSRR_4b-zuSksHOlqvLrEhorWM1hSUE7fVgvXOh7amlHLg-PZnGTr65yzpjjpYuXpe7oHgqWCWlCBx5IFgj-nmVvTVG35MBSv921-bTQhUZQ6f28pEdb6Oq5cPSktLuvvxsmM Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: e11b8d4a14a9460eb4ce9967f86e4757 Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:44:26.253611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:44:26.255876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:26.255876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:26.255876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: e11b8d4a14a9460eb4ce9967f86e4757 Sep 01 17:44:26.255876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:26.255876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-AttachVolumeShelveTestJSON-1402317429-project Sep 01 17:44:26.255876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:44:26.255876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:44:26.255876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: bcc538bc852f404699d91d17023ae620 Sep 01 17:44:26.255876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1402317429-project Sep 01 17:44:26.255876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:44:26.255876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:44:26.255876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '7fc52ad3-09b3-4851-8a50-ad446bd1a75d'} Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:26.256752 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:44:26.258206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:26.259674 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4eb88a32-bd02-491b-a225-ca1ea1277701 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Returning 404 to user: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:26.259674 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4eb88a32-bd02-491b-a225-ca1ea1277701 tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 404 len: 111 microversion: 2.20 time: 0.031811 Sep 01 17:44:26.259674 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 462/966] 10.222.0.100 () {60 vars in 1285 bytes} [Thu Sep 1 17:44:26 2022] DELETE /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 17:44:26.264622 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c5154985-7077-43e8-83d7-11085af7fabb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:26.265238 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c5154985-7077-43e8-83d7-11085af7fabb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] [instance: 7fc52ad3-09b3-4851-8a50-ad446bd1a75d] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:26.272547 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c5154985-7077-43e8-83d7-11085af7fabb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:26.273039 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c5154985-7077-43e8-83d7-11085af7fabb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:26.273479 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c5154985-7077-43e8-83d7-11085af7fabb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:26.274565 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c5154985-7077-43e8-83d7-11085af7fabb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:26.275253 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c5154985-7077-43e8-83d7-11085af7fabb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:26.275858 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c5154985-7077-43e8-83d7-11085af7fabb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:26.289866 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-c5154985-7077-43e8-83d7-11085af7fabb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] HTTP exception thrown: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c5154985-7077-43e8-83d7-11085af7fabb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Request method failure captured: Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d HTTP/1.1 Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO2ta67Nt658ECETsKDQS04ve5Vd2ka7ziEOrDDh7dgSRR_4b-zuSksHOlqvLrEhorWM1hSUE7fVgvXOh7amlHLg-PZnGTr65yzpjjpYuXpe7oHgqWCWlCBx5IFgj-nmVvTVG35MBSv921-bTQhUZQ6f28pEdb6Oq5cPSktLuvvxsmM Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: e11b8d4a14a9460eb4ce9967f86e4757 Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:44:26.291692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:44:26.293312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e11b8d4a14a9460eb4ce9967f86e4757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:26.293312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:26.293312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: e11b8d4a14a9460eb4ce9967f86e4757 Sep 01 17:44:26.293312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1402317429 Sep 01 17:44:26.293312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-AttachVolumeShelveTestJSON-1402317429-project Sep 01 17:44:26.293312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:44:26.293312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:44:26.293312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: bcc538bc852f404699d91d17023ae620 Sep 01 17:44:26.293312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1402317429-project Sep 01 17:44:26.293312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:44:26.293312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:44:26.293312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '7fc52ad3-09b3-4851-8a50-ad446bd1a75d'} Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:26.294197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. Sep 01 17:44:26.295609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:26.296899 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c5154985-7077-43e8-83d7-11085af7fabb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] Returning 404 to user: Instance 7fc52ad3-09b3-4851-8a50-ad446bd1a75d could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:26.296899 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-c5154985-7077-43e8-83d7-11085af7fabb tempest-AttachVolumeShelveTestJSON-1402317429 tempest-AttachVolumeShelveTestJSON-1402317429-project] 10.222.0.100 "GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d" status: 404 len: 111 microversion: 2.20 time: 0.032383 Sep 01 17:44:26.296899 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 505/967] 10.222.0.100 () {60 vars in 1282 bytes} [Thu Sep 1 17:44:26 2022] GET /compute/v2.1/servers/7fc52ad3-09b3-4851-8a50-ad446bd1a75d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:44:27.651024 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-73cfa881-16a4-491d-8c72-748ceda4c761 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:27.651719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-73cfa881-16a4-491d-8c72-748ceda4c761 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:27.658284 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-73cfa881-16a4-491d-8c72-748ceda4c761 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:27.658712 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-73cfa881-16a4-491d-8c72-748ceda4c761 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:27.659154 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-73cfa881-16a4-491d-8c72-748ceda4c761 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:27.659857 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-73cfa881-16a4-491d-8c72-748ceda4c761 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:27.660311 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-73cfa881-16a4-491d-8c72-748ceda4c761 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:27.660734 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-73cfa881-16a4-491d-8c72-748ceda4c761 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:27.749201 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-73cfa881-16a4-491d-8c72-748ceda4c761 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lazy-loading 'services' on Instance uuid ef9599ab-1a96-43d5-8c63-03f62d3d2700 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:44:27.830920 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-73cfa881-16a4-491d-8c72-748ceda4c761 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700/os-volume_attachments/f6e24f92-dc52-408a-995d-636aa3841666" status: 202 len: 0 microversion: 2.1 time: 0.183918 Sep 01 17:44:27.831525 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 463/968] 10.222.0.100 () {58 vars in 1421 bytes} [Thu Sep 1 17:44:27 2022] DELETE /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700/os-volume_attachments/f6e24f92-dc52-408a-995d-636aa3841666 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:44:27.841094 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5179eb0c-c5b9-4239-b4b9-37f0d04d1eb2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:27.845093 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5179eb0c-c5b9-4239-b4b9-37f0d04d1eb2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:27.852815 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5179eb0c-c5b9-4239-b4b9-37f0d04d1eb2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:27.853420 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5179eb0c-c5b9-4239-b4b9-37f0d04d1eb2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:27.854128 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5179eb0c-c5b9-4239-b4b9-37f0d04d1eb2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:27.855066 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5179eb0c-c5b9-4239-b4b9-37f0d04d1eb2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:27.855695 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5179eb0c-c5b9-4239-b4b9-37f0d04d1eb2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:27.856291 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5179eb0c-c5b9-4239-b4b9-37f0d04d1eb2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:27.896297 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5179eb0c-c5b9-4239-b4b9-37f0d04d1eb2 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059947 Sep 01 17:44:27.897006 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 506/969] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:44:27 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:44:28.909453 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a0063665-6964-4cc8-9b9a-c94419330e19 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:28.912236 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a0063665-6964-4cc8-9b9a-c94419330e19 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:28.918689 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a0063665-6964-4cc8-9b9a-c94419330e19 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:28.919163 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a0063665-6964-4cc8-9b9a-c94419330e19 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:28.919596 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a0063665-6964-4cc8-9b9a-c94419330e19 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:28.920282 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a0063665-6964-4cc8-9b9a-c94419330e19 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:28.920733 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a0063665-6964-4cc8-9b9a-c94419330e19 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:28.921150 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a0063665-6964-4cc8-9b9a-c94419330e19 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:28.951490 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a0063665-6964-4cc8-9b9a-c94419330e19 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046782 Sep 01 17:44:28.952174 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 464/970] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:44:28 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:44:29.015108 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6550c697-1d8a-45c8-93e6-e36e65ef9115 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:29.015712 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6550c697-1d8a-45c8-93e6-e36e65ef9115 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:29.022193 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6550c697-1d8a-45c8-93e6-e36e65ef9115 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:29.023143 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6550c697-1d8a-45c8-93e6-e36e65ef9115 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:29.023553 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6550c697-1d8a-45c8-93e6-e36e65ef9115 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:29.024287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6550c697-1d8a-45c8-93e6-e36e65ef9115 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:29.024738 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6550c697-1d8a-45c8-93e6-e36e65ef9115 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:29.025158 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6550c697-1d8a-45c8-93e6-e36e65ef9115 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:29.053330 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6550c697-1d8a-45c8-93e6-e36e65ef9115 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Going to try to terminate instance {{(pid=127233) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:44:29.137051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-6550c697-1d8a-45c8-93e6-e36e65ef9115 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 204 len: 0 microversion: 2.1 time: 0.125598 Sep 01 17:44:29.137562 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 507/971] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:44:29 2022] DELETE /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:29.146149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a6204e27-d632-4e63-a574-8a94b0418425 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:29.146875 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a6204e27-d632-4e63-a574-8a94b0418425 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:29.152916 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a6204e27-d632-4e63-a574-8a94b0418425 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:29.153402 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a6204e27-d632-4e63-a574-8a94b0418425 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:29.153874 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a6204e27-d632-4e63-a574-8a94b0418425 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:29.154565 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a6204e27-d632-4e63-a574-8a94b0418425 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:29.155260 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a6204e27-d632-4e63-a574-8a94b0418425 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:29.157726 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a6204e27-d632-4e63-a574-8a94b0418425 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:29.351304 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a6204e27-d632-4e63-a574-8a94b0418425 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:29.360366 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a6204e27-d632-4e63-a574-8a94b0418425 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1686 microversion: 2.1 time: 0.218143 Sep 01 17:44:29.360954 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 465/972] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:29 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1686 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:30.383731 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-3baf2dd4-80c6-4745-92af-1076d0e8e3c3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:30.384443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-3baf2dd4-80c6-4745-92af-1076d0e8e3c3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:30.390930 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3baf2dd4-80c6-4745-92af-1076d0e8e3c3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:30.391418 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3baf2dd4-80c6-4745-92af-1076d0e8e3c3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:30.391864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3baf2dd4-80c6-4745-92af-1076d0e8e3c3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:30.392571 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3baf2dd4-80c6-4745-92af-1076d0e8e3c3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:30.393026 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3baf2dd4-80c6-4745-92af-1076d0e8e3c3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:30.393456 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-3baf2dd4-80c6-4745-92af-1076d0e8e3c3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:30.533354 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-3baf2dd4-80c6-4745-92af-1076d0e8e3c3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:30.541652 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-3baf2dd4-80c6-4745-92af-1076d0e8e3c3 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1686 microversion: 2.1 time: 0.162651 Sep 01 17:44:30.542266 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 508/973] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:30 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:31.564020 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-ace25990-966d-4e3c-9cf0-9bdf2378ff20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:31.564648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-ace25990-966d-4e3c-9cf0-9bdf2378ff20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:31.571522 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ace25990-966d-4e3c-9cf0-9bdf2378ff20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:31.572071 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ace25990-966d-4e3c-9cf0-9bdf2378ff20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:31.572510 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ace25990-966d-4e3c-9cf0-9bdf2378ff20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:31.573211 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ace25990-966d-4e3c-9cf0-9bdf2378ff20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:31.573690 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ace25990-966d-4e3c-9cf0-9bdf2378ff20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:31.574119 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-ace25990-966d-4e3c-9cf0-9bdf2378ff20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:31.641295 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-ace25990-966d-4e3c-9cf0-9bdf2378ff20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3848643d2c44951b78814ccf7d504af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf7216d5c904b24a9665755720cf287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:31.656564 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-ace25990-966d-4e3c-9cf0-9bdf2378ff20 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 200 len: 1618 microversion: 2.1 time: 0.097134 Sep 01 17:44:31.657195 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 466/974] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:31 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 1618 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:31.822410 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-0b117d60-d653-4771-92dc-2e475374c40b req-b420b51e-e1a8-4ebf-a78e-b9691b5fa320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef9599ab-1a96-43d5-8c63-03f62d3d2700", "name": "network-vif-deleted", "tag": "c65a97d3-50de-4e75-8bde-ed4f1c7c8aab"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:31.859573 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-0b117d60-d653-4771-92dc-2e475374c40b req-b420b51e-e1a8-4ebf-a78e-b9691b5fa320 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:31.860121 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-0b117d60-d653-4771-92dc-2e475374c40b req-b420b51e-e1a8-4ebf-a78e-b9691b5fa320 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:31.860849 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-0b117d60-d653-4771-92dc-2e475374c40b req-b420b51e-e1a8-4ebf-a78e-b9691b5fa320 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:31.905096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-0b117d60-d653-4771-92dc-2e475374c40b req-b420b51e-e1a8-4ebf-a78e-b9691b5fa320 service nova] Creating event network-vif-deleted:c65a97d3-50de-4e75-8bde-ed4f1c7c8aab for instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 on hv-cinder-83976 Sep 01 17:44:31.925899 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-0b117d60-d653-4771-92dc-2e475374c40b req-b420b51e-e1a8-4ebf-a78e-b9691b5fa320 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107365 Sep 01 17:44:31.926936 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 509/975] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:44:32.679015 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-da2cfd04-e2cd-451f-86fc-9c1100f9d7df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:32.679894 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-da2cfd04-e2cd-451f-86fc-9c1100f9d7df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:32.687474 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da2cfd04-e2cd-451f-86fc-9c1100f9d7df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:32.688426 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da2cfd04-e2cd-451f-86fc-9c1100f9d7df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:32.688930 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da2cfd04-e2cd-451f-86fc-9c1100f9d7df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:32.689766 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da2cfd04-e2cd-451f-86fc-9c1100f9d7df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:32.690820 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da2cfd04-e2cd-451f-86fc-9c1100f9d7df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:32.691252 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-da2cfd04-e2cd-451f-86fc-9c1100f9d7df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:32.707102 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-da2cfd04-e2cd-451f-86fc-9c1100f9d7df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-da2cfd04-e2cd-451f-86fc-9c1100f9d7df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 HTTP/1.1 Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:44:32.709470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:44:32.711374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:32.711374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:32.711374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:32.711374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:32.711374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:32.711374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:44:32.711374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:44:32.711374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:44:32.711374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:32.711374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:44:32.711374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:32.711374 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': 'ef9599ab-1a96-43d5-8c63-03f62d3d2700'} Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:32.712171 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:32.713624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:32.714873 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-da2cfd04-e2cd-451f-86fc-9c1100f9d7df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 404 to user: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:32.714873 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-da2cfd04-e2cd-451f-86fc-9c1100f9d7df tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 404 len: 111 microversion: 2.1 time: 0.035977 Sep 01 17:44:32.714873 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 467/976] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:32 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:44:32.721364 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-bc2360c8-eff7-4c5a-9af6-9afb50ce3ee0 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '.version_select at 0x7f354a73d5e0>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:32.747004 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-bc2360c8-eff7-4c5a-9af6-9afb50ce3ee0 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1933242316" status: 202 len: 0 microversion: 2.1 time: 0.030770 Sep 01 17:44:32.751905 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 510/977] 10.222.0.100 () {58 vars in 1226 bytes} [Thu Sep 1 17:44:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1933242316 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:44:34.724331 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-81d55aa7-758b-4f13-aac2-1fd0e54f51be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:34.724988 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-81d55aa7-758b-4f13-aac2-1fd0e54f51be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:34.731475 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81d55aa7-758b-4f13-aac2-1fd0e54f51be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:34.731886 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81d55aa7-758b-4f13-aac2-1fd0e54f51be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:34.732321 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81d55aa7-758b-4f13-aac2-1fd0e54f51be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:34.733029 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81d55aa7-758b-4f13-aac2-1fd0e54f51be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:34.733483 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81d55aa7-758b-4f13-aac2-1fd0e54f51be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:34.733944 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81d55aa7-758b-4f13-aac2-1fd0e54f51be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:34.748246 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-81d55aa7-758b-4f13-aac2-1fd0e54f51be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-81d55aa7-758b-4f13-aac2-1fd0e54f51be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: DELETE /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 HTTP/1.1 Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:44:34.749843 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:44:34.751701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:34.751701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:34.751701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:34.751701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:34.751701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:34.751701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:44:34.751701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:44:34.751701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:44:34.751701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:34.751701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:44:34.751701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:34.751701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': 'ef9599ab-1a96-43d5-8c63-03f62d3d2700'} Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:34.752576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:34.754054 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:34.755688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-81d55aa7-758b-4f13-aac2-1fd0e54f51be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 404 to user: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:34.755688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-81d55aa7-758b-4f13-aac2-1fd0e54f51be tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 404 len: 111 microversion: 2.1 time: 0.031374 Sep 01 17:44:34.755688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 468/978] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:44:34 2022] DELETE /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:44:34.761118 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ef57fc6e-e98d-4a8d-97be-e3efc8835250 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:34.762079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ef57fc6e-e98d-4a8d-97be-e3efc8835250 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: ef9599ab-1a96-43d5-8c63-03f62d3d2700] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:34.768740 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ef57fc6e-e98d-4a8d-97be-e3efc8835250 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:34.769217 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ef57fc6e-e98d-4a8d-97be-e3efc8835250 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:34.769679 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ef57fc6e-e98d-4a8d-97be-e3efc8835250 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:34.770946 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ef57fc6e-e98d-4a8d-97be-e3efc8835250 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:34.771423 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ef57fc6e-e98d-4a8d-97be-e3efc8835250 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:34.771868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ef57fc6e-e98d-4a8d-97be-e3efc8835250 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:34.785505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-ef57fc6e-e98d-4a8d-97be-e3efc8835250 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ef57fc6e-e98d-4a8d-97be-e3efc8835250 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 HTTP/1.1 Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:44:34.787904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:44:34.789541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:34.789541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:34.789541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:34.789541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:34.789541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:34.789541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:44:34.789541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:44:34.789541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:44:34.789541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:34.789541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:44:34.789541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:34.789541 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': 'ef9599ab-1a96-43d5-8c63-03f62d3d2700'} Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:34.790488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. Sep 01 17:44:34.792689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:34.794040 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ef57fc6e-e98d-4a8d-97be-e3efc8835250 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 404 to user: Instance ef9599ab-1a96-43d5-8c63-03f62d3d2700 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:34.794040 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ef57fc6e-e98d-4a8d-97be-e3efc8835250 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700" status: 404 len: 111 microversion: 2.1 time: 0.032274 Sep 01 17:44:34.794040 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 511/979] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:34 2022] GET /compute/v2.1/servers/ef9599ab-1a96-43d5-8c63-03f62d3d2700 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:44:35.965204 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3d5b0f25-0bd0-4e5a-abab-a37f299641c5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:35.965973 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3d5b0f25-0bd0-4e5a-abab-a37f299641c5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:35.972203 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3d5b0f25-0bd0-4e5a-abab-a37f299641c5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:35.972682 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3d5b0f25-0bd0-4e5a-abab-a37f299641c5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:35.973110 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3d5b0f25-0bd0-4e5a-abab-a37f299641c5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:35.973921 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3d5b0f25-0bd0-4e5a-abab-a37f299641c5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:35.974486 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3d5b0f25-0bd0-4e5a-abab-a37f299641c5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:35.974895 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-3d5b0f25-0bd0-4e5a-abab-a37f299641c5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:35.989526 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-3d5b0f25-0bd0-4e5a-abab-a37f299641c5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3d5b0f25-0bd0-4e5a-abab-a37f299641c5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: DELETE /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 HTTP/1.1 Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:44:35.991156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:44:35.992702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:35.992702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:35.992702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:35.992702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:35.992702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:35.992702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:44:35.992702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:44:35.992702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:44:35.992702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:35.992702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:44:35.992702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:44:35.992702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '72608990-e16b-4544-9ce6-d340d1c8c577'} Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:35.993989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:44:35.995498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:35.997125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3d5b0f25-0bd0-4e5a-abab-a37f299641c5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 404 to user: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:35.997125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-3d5b0f25-0bd0-4e5a-abab-a37f299641c5 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 404 len: 111 microversion: 2.1 time: 0.031235 Sep 01 17:44:35.997125 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 469/980] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:44:35 2022] DELETE /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:44:36.001908 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a9ba9a89-a40f-4482-994d-9c0a568e0767 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:36.002510 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a9ba9a89-a40f-4482-994d-9c0a568e0767 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 72608990-e16b-4544-9ce6-d340d1c8c577] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:36.009730 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a9ba9a89-a40f-4482-994d-9c0a568e0767 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:36.010210 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a9ba9a89-a40f-4482-994d-9c0a568e0767 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:36.010811 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a9ba9a89-a40f-4482-994d-9c0a568e0767 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:36.011518 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a9ba9a89-a40f-4482-994d-9c0a568e0767 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:36.011968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a9ba9a89-a40f-4482-994d-9c0a568e0767 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:36.012386 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a9ba9a89-a40f-4482-994d-9c0a568e0767 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:36.026116 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-a9ba9a89-a40f-4482-994d-9c0a568e0767 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a9ba9a89-a40f-4482-994d-9c0a568e0767 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 HTTP/1.1 Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:44:36.027638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:44:36.029715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:36.029715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:36.029715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:36.029715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:36.029715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:36.029715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:44:36.029715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:44:36.029715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:44:36.029715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:36.029715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:44:36.029715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:44:36.029715 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '72608990-e16b-4544-9ce6-d340d1c8c577'} Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:36.030615 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. Sep 01 17:44:36.032363 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.034138 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a9ba9a89-a40f-4482-994d-9c0a568e0767 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 404 to user: Instance 72608990-e16b-4544-9ce6-d340d1c8c577 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:36.034138 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a9ba9a89-a40f-4482-994d-9c0a568e0767 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577" status: 404 len: 111 microversion: 2.1 time: 0.031018 Sep 01 17:44:36.034138 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 512/981] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:35 2022] GET /compute/v2.1/servers/72608990-e16b-4544-9ce6-d340d1c8c577 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 17:44:36.037845 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c1e7b481-cf73-42e0-ad0c-d5adcc0c9b1b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:36.038337 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c1e7b481-cf73-42e0-ad0c-d5adcc0c9b1b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:36.044885 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c1e7b481-cf73-42e0-ad0c-d5adcc0c9b1b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:36.045433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c1e7b481-cf73-42e0-ad0c-d5adcc0c9b1b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:36.045909 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c1e7b481-cf73-42e0-ad0c-d5adcc0c9b1b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:36.046597 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c1e7b481-cf73-42e0-ad0c-d5adcc0c9b1b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:36.047166 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c1e7b481-cf73-42e0-ad0c-d5adcc0c9b1b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:36.047557 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c1e7b481-cf73-42e0-ad0c-d5adcc0c9b1b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:36.061974 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-c1e7b481-cf73-42e0-ad0c-d5adcc0c9b1b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c1e7b481-cf73-42e0-ad0c-d5adcc0c9b1b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: DELETE /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da HTTP/1.1 Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:44:36.063550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:44:36.065215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:36.065215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:36.065215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:36.065215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:36.065215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:36.065215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:44:36.065215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:44:36.065215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:44:36.065215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:36.065215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:44:36.065215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:44:36.065215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '92e176cb-aabb-40b5-a79d-acf5d061b2da'} Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:36.066447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:44:36.067785 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.069942 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c1e7b481-cf73-42e0-ad0c-d5adcc0c9b1b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 404 to user: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:36.069942 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c1e7b481-cf73-42e0-ad0c-d5adcc0c9b1b tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 404 len: 111 microversion: 2.1 time: 0.031142 Sep 01 17:44:36.069942 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 470/982] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:44:36 2022] DELETE /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:44:36.074287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-69aebe33-f68f-4b31-ab95-a5b5572ee4c4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:36.074900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-69aebe33-f68f-4b31-ab95-a5b5572ee4c4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 92e176cb-aabb-40b5-a79d-acf5d061b2da] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:36.080762 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-69aebe33-f68f-4b31-ab95-a5b5572ee4c4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:36.081240 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-69aebe33-f68f-4b31-ab95-a5b5572ee4c4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:36.081724 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-69aebe33-f68f-4b31-ab95-a5b5572ee4c4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:36.082415 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-69aebe33-f68f-4b31-ab95-a5b5572ee4c4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:36.082897 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-69aebe33-f68f-4b31-ab95-a5b5572ee4c4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:36.083347 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-69aebe33-f68f-4b31-ab95-a5b5572ee4c4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:36.096872 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-69aebe33-f68f-4b31-ab95-a5b5572ee4c4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-69aebe33-f68f-4b31-ab95-a5b5572ee4c4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da HTTP/1.1 Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:44:36.098495 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:44:36.100053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:36.100053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:36.100053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:36.100053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:36.100053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:36.100053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:44:36.100053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:44:36.100053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:44:36.100053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:36.100053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:44:36.100053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:44:36.100053 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '92e176cb-aabb-40b5-a79d-acf5d061b2da'} Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:36.101028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. Sep 01 17:44:36.102696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:36.103985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-69aebe33-f68f-4b31-ab95-a5b5572ee4c4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 404 to user: Instance 92e176cb-aabb-40b5-a79d-acf5d061b2da could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:36.103985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-69aebe33-f68f-4b31-ab95-a5b5572ee4c4 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da" status: 404 len: 111 microversion: 2.1 time: 0.029519 Sep 01 17:44:36.103985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 513/983] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:36 2022] GET /compute/v2.1/servers/92e176cb-aabb-40b5-a79d-acf5d061b2da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:44:37.250107 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cbeb5fdd-f202-4706-ad40-c305f456fffe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:37.250865 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-cbeb5fdd-f202-4706-ad40-c305f456fffe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:37.258196 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbeb5fdd-f202-4706-ad40-c305f456fffe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:37.261796 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbeb5fdd-f202-4706-ad40-c305f456fffe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:37.261796 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbeb5fdd-f202-4706-ad40-c305f456fffe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:37.261796 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbeb5fdd-f202-4706-ad40-c305f456fffe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:37.261796 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbeb5fdd-f202-4706-ad40-c305f456fffe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:37.262164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbeb5fdd-f202-4706-ad40-c305f456fffe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:37.275635 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-cbeb5fdd-f202-4706-ad40-c305f456fffe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cbeb5fdd-f202-4706-ad40-c305f456fffe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: DELETE /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 HTTP/1.1 Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:44:37.277190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:44:37.278794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:37.278794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:37.278794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:37.278794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:37.278794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:37.278794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:44:37.278794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:44:37.278794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:44:37.278794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:37.278794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:44:37.278794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:44:37.278794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '48752724-82dc-4307-98af-ccc606bf5ca0'} Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:37.279719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:44:37.281219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:44:37.282755 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cbeb5fdd-f202-4706-ad40-c305f456fffe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 404 to user: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:37.282755 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-cbeb5fdd-f202-4706-ad40-c305f456fffe tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "DELETE /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 404 len: 111 microversion: 2.1 time: 0.033109 Sep 01 17:44:37.282755 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 471/984] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:44:37 2022] DELETE /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:44:37.292186 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-99ef977d-e239-4dc3-a3af-cf98428d9d75 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:37.293120 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-99ef977d-e239-4dc3-a3af-cf98428d9d75 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] [instance: 48752724-82dc-4307-98af-ccc606bf5ca0] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:37.299292 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-99ef977d-e239-4dc3-a3af-cf98428d9d75 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:37.299781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-99ef977d-e239-4dc3-a3af-cf98428d9d75 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:37.300217 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-99ef977d-e239-4dc3-a3af-cf98428d9d75 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:37.300924 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-99ef977d-e239-4dc3-a3af-cf98428d9d75 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:37.301391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-99ef977d-e239-4dc3-a3af-cf98428d9d75 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:37.302481 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-99ef977d-e239-4dc3-a3af-cf98428d9d75 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:37.315986 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-99ef977d-e239-4dc3-a3af-cf98428d9d75 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] HTTP exception thrown: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-99ef977d-e239-4dc3-a3af-cf98428d9d75 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Request method failure captured: Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 HTTP/1.1 Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO4UpHfHosLYiBBpfaDEAzM2xgkreJf41OD_Eg4tN3-TwPE27qRHrLycN6ZduNNowZYFXnOTvAeLoIotbG5SuUTpvbvdO0sNOH-68A2rBMHG1-oV9gDy6GgDAZ_2X_TD6doQ-Oh1JmXuv_NPM5Kvx5MpQ99JcPb83Ah262cglCEf534 Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:44:37.318028 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:44:37.319650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1cf7216d5c904b24a9665755720cf287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1cf7216d5c904b24a9665755720cf287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:44:37.319650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:37.319650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 1cf7216d5c904b24a9665755720cf287 Sep 01 17:44:37.319650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-966830071 Sep 01 17:44:37.319650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:37.319650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:44:37.319650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:44:37.319650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: d3848643d2c44951b78814ccf7d504af Sep 01 17:44:37.319650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-AttachVolumeNegativeTest-966830071-project Sep 01 17:44:37.319650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:44:37.319650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:44:37.319650 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '48752724-82dc-4307-98af-ccc606bf5ca0'} Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:37.320523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. Sep 01 17:44:37.322009 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:44:37.323375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-99ef977d-e239-4dc3-a3af-cf98428d9d75 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] Returning 404 to user: Instance 48752724-82dc-4307-98af-ccc606bf5ca0 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:37.323375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-99ef977d-e239-4dc3-a3af-cf98428d9d75 tempest-AttachVolumeNegativeTest-966830071 tempest-AttachVolumeNegativeTest-966830071-project] 10.222.0.100 "GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0" status: 404 len: 111 microversion: 2.1 time: 0.031867 Sep 01 17:44:37.323375 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 514/985] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:37 2022] GET /compute/v2.1/servers/48752724-82dc-4307-98af-ccc606bf5ca0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:44:43.786632 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-74fbf72b-71fc-45a3-8c77-e9caecd5d891 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] Calling method '.version_select at 0x7f354a5565e0>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:43.827323 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-96c3c75a-f107-4f0b-9ad2-eb2471d51e62 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:43.829614 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-96c3c75a-f107-4f0b-9ad2-eb2471d51e62 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:43.843735 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-96c3c75a-f107-4f0b-9ad2-eb2471d51e62 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:43.844435 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-96c3c75a-f107-4f0b-9ad2-eb2471d51e62 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:43.846071 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-96c3c75a-f107-4f0b-9ad2-eb2471d51e62 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:43.846808 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-96c3c75a-f107-4f0b-9ad2-eb2471d51e62 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:43.847274 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-96c3c75a-f107-4f0b-9ad2-eb2471d51e62 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:43.847709 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-96c3c75a-f107-4f0b-9ad2-eb2471d51e62 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:43.854654 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-74fbf72b-71fc-45a3-8c77-e9caecd5d891 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/b6c1bfd9-cf82-4c3b-95c1-1fcc571dc8c7" status: 200 len: 351 microversion: 2.1 time: 0.073194 Sep 01 17:44:43.855773 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 472/986] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:44:43 2022] GET /compute/v2.1/os-volumes/b6c1bfd9-cf82-4c3b-95c1-1fcc571dc8c7 => generated 351 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:44.019366 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-96c3c75a-f107-4f0b-9ad2-eb2471d51e62 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lazy-loading 'services' on Instance uuid bad71e4c-acb3-4e98-a9a4-5cd212974512 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:44:44.121912 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-96c3c75a-f107-4f0b-9ad2-eb2471d51e62 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "DELETE /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/os-volume_attachments/1817aa04-5b76-4687-8f31-5d32ca044dbc" status: 202 len: 0 microversion: 2.1 time: 0.305467 Sep 01 17:44:44.122691 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 515/987] 10.222.0.100 () {58 vars in 1421 bytes} [Thu Sep 1 17:44:43 2022] DELETE /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/os-volume_attachments/1817aa04-5b76-4687-8f31-5d32ca044dbc => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:44:45.308904 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-83005118-6f35-4acb-8f9e-5795c687a3eb tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] Calling method '.version_select at 0x7f354dea5d30>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:45.344378 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-974d29a2-2560-41ac-ae8f-d89c98a4579f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:45.354110 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-974d29a2-2560-41ac-ae8f-d89c98a4579f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:45.355521 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-974d29a2-2560-41ac-ae8f-d89c98a4579f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:45.356233 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-974d29a2-2560-41ac-ae8f-d89c98a4579f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:45.365845 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-83005118-6f35-4acb-8f9e-5795c687a3eb tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/6d48a58b-14fe-470b-bf6c-e6b82a043eeb" status: 200 len: 350 microversion: 2.1 time: 0.062790 Sep 01 17:44:45.374190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 473/988] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:44:45 2022] GET /compute/v2.1/os-volumes/6d48a58b-14fe-470b-bf6c-e6b82a043eeb => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:45.387480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-974d29a2-2560-41ac-ae8f-d89c98a4579f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Going to try to stop instance {{(pid=127233) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 17:44:45.435985 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-974d29a2-2560-41ac-ae8f-d89c98a4579f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "POST /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/action" status: 202 len: 0 microversion: 2.1 time: 0.098778 Sep 01 17:44:45.436746 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 516/989] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:44:45 2022] POST /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 17:44:45.448270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-203a0c62-3846-4c97-979f-74e1f852517d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:45.449653 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-203a0c62-3846-4c97-979f-74e1f852517d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:45.460615 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-203a0c62-3846-4c97-979f-74e1f852517d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:45.461434 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-203a0c62-3846-4c97-979f-74e1f852517d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:45.462011 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-203a0c62-3846-4c97-979f-74e1f852517d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:45.463010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-203a0c62-3846-4c97-979f-74e1f852517d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:45.463545 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-203a0c62-3846-4c97-979f-74e1f852517d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:45.464079 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-203a0c62-3846-4c97-979f-74e1f852517d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:45.695534 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-203a0c62-3846-4c97-979f-74e1f852517d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:45.705738 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-203a0c62-3846-4c97-979f-74e1f852517d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1680 microversion: 2.1 time: 0.264683 Sep 01 17:44:45.706994 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 474/990] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:45 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1680 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:46.729281 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-797efa2f-466f-4474-b324-c5c694d90289 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:46.730001 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-797efa2f-466f-4474-b324-c5c694d90289 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:46.736176 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-797efa2f-466f-4474-b324-c5c694d90289 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:46.736660 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-797efa2f-466f-4474-b324-c5c694d90289 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:46.737096 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-797efa2f-466f-4474-b324-c5c694d90289 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:46.737812 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-797efa2f-466f-4474-b324-c5c694d90289 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:46.738267 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-797efa2f-466f-4474-b324-c5c694d90289 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:46.739220 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-797efa2f-466f-4474-b324-c5c694d90289 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:46.820878 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-04c756c2-e828-4e48-ac3a-a12c393ec70a tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] Calling method '.version_select at 0x7f354dea50d0>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:46.873995 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-04c756c2-e828-4e48-ac3a-a12c393ec70a tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/fd70bed0-caf2-46eb-a1e0-bf71ab916d2d" status: 200 len: 351 microversion: 2.1 time: 0.057586 Sep 01 17:44:46.874764 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 475/991] 10.222.0.100 () {58 vars in 1250 bytes} [Thu Sep 1 17:44:46 2022] GET /compute/v2.1/os-volumes/fd70bed0-caf2-46eb-a1e0-bf71ab916d2d => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:44:46.878869 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-797efa2f-466f-4474-b324-c5c694d90289 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:46.887392 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-0ad581bc-3b4f-4406-8568-a66ad30c6861 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] Calling method '.version_select at 0x7f354df4f1f0>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:46.888237 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-797efa2f-466f-4474-b324-c5c694d90289 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1680 microversion: 2.1 time: 0.163511 Sep 01 17:44:46.889054 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 517/992] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:46 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:46.981661 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-0ad581bc-3b4f-4406-8568-a66ad30c6861 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] 10.222.0.100 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.098083 Sep 01 17:44:46.982237 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 476/993] 10.222.0.100 () {58 vars in 1139 bytes} [Thu Sep 1 17:44:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:44:46.996696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1385a731-86a2-4495-b051-8552a7c4f048 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] Calling method '.version_select at 0x7f354a68fc10>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:47.086205 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1385a731-86a2-4495-b051-8552a7c4f048 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] 10.222.0.100 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093257 Sep 01 17:44:47.086923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 518/994] 10.222.0.100 () {58 vars in 1154 bytes} [Thu Sep 1 17:44:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:47.101173 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-74bf5642-b64f-494a-87bd-a8f2364e8c68 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] Calling method '.version_select at 0x7f354a5481f0>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:47.189732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-74bf5642-b64f-494a-87bd-a8f2364e8c68 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] 10.222.0.100 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092843 Sep 01 17:44:47.190450 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 477/995] 10.222.0.100 () {58 vars in 1139 bytes} [Thu Sep 1 17:44:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:44:47.203100 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1ca41c2e-664f-4c3f-82d1-174966076481 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] Calling method '.version_select at 0x7f354a42b790>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:47.292069 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1ca41c2e-664f-4c3f-82d1-174966076481 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] 10.222.0.100 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092736 Sep 01 17:44:47.292633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 519/996] 10.222.0.100 () {58 vars in 1172 bytes} [Thu Sep 1 17:44:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:47.306382 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-52f76233-f1b3-4726-8c83-bd259d3780a0 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] Calling method '.version_select at 0x7f354a70cf70>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:47.394283 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-52f76233-f1b3-4726-8c83-bd259d3780a0 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091880 Sep 01 17:44:47.395035 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 478/997] 10.222.0.100 () {58 vars in 1175 bytes} [Thu Sep 1 17:44:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:47.408450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7c0ba7d7-3ecc-43fe-ac25-9c9d1e22061d tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] Calling method '.version_select at 0x7f354a6dfa60>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:47.505516 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7c0ba7d7-3ecc-43fe-ac25-9c9d1e22061d tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099861 Sep 01 17:44:47.506292 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 520/998] 10.222.0.100 () {58 vars in 1160 bytes} [Thu Sep 1 17:44:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:47.519056 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-010a6a1f-1c83-4d0c-873a-1d9ea82de5bf tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] Calling method '.version_select at 0x7f354dea59d0>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:47.610950 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-010a6a1f-1c83-4d0c-873a-1d9ea82de5bf tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091434 Sep 01 17:44:47.611581 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 479/999] 10.222.0.100 () {58 vars in 1193 bytes} [Thu Sep 1 17:44:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:47.624676 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-0c8c2458-47d3-41dc-a7ce-ea8b523e3ed7 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] Calling method '.version_select at 0x7f354a55dc10>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:47.710931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-0c8c2458-47d3-41dc-a7ce-ea8b523e3ed7 tempest-VolumesTestJSON-1933998019 tempest-VolumesTestJSON-1933998019-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089959 Sep 01 17:44:47.711508 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 521/1000] 10.222.0.100 () {58 vars in 1160 bytes} [Thu Sep 1 17:44:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:47.911379 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-018ca7e3-5e05-4585-a0dc-38774a7a4d5e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:47.912036 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-018ca7e3-5e05-4585-a0dc-38774a7a4d5e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:47.920088 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-018ca7e3-5e05-4585-a0dc-38774a7a4d5e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:47.920591 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-018ca7e3-5e05-4585-a0dc-38774a7a4d5e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:47.921041 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-018ca7e3-5e05-4585-a0dc-38774a7a4d5e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:47.921905 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-018ca7e3-5e05-4585-a0dc-38774a7a4d5e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:47.922428 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-018ca7e3-5e05-4585-a0dc-38774a7a4d5e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:47.922899 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-018ca7e3-5e05-4585-a0dc-38774a7a4d5e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:48.075090 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-018ca7e3-5e05-4585-a0dc-38774a7a4d5e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:48.083018 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-018ca7e3-5e05-4585-a0dc-38774a7a4d5e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1680 microversion: 2.1 time: 0.176642 Sep 01 17:44:48.083687 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 480/1001] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:47 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:49.105013 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7c72a766-7e82-40c0-8d5a-868ed4599341 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:49.105664 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7c72a766-7e82-40c0-8d5a-868ed4599341 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:49.112270 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7c72a766-7e82-40c0-8d5a-868ed4599341 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:49.112757 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7c72a766-7e82-40c0-8d5a-868ed4599341 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:49.113190 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7c72a766-7e82-40c0-8d5a-868ed4599341 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:49.114720 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7c72a766-7e82-40c0-8d5a-868ed4599341 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:49.115336 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7c72a766-7e82-40c0-8d5a-868ed4599341 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:49.115766 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7c72a766-7e82-40c0-8d5a-868ed4599341 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:49.252190 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7c72a766-7e82-40c0-8d5a-868ed4599341 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:49.256539 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:49.262328 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7c72a766-7e82-40c0-8d5a-868ed4599341 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1680 microversion: 2.1 time: 0.161779 Sep 01 17:44:49.262904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 522/1002] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:49 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:50.284948 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-c23b4cbe-1886-4c34-a4c4-9ffb210dff6f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:50.285631 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-c23b4cbe-1886-4c34-a4c4-9ffb210dff6f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:50.288736 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:50.294351 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c23b4cbe-1886-4c34-a4c4-9ffb210dff6f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:50.294954 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c23b4cbe-1886-4c34-a4c4-9ffb210dff6f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:50.295285 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c23b4cbe-1886-4c34-a4c4-9ffb210dff6f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:50.295988 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c23b4cbe-1886-4c34-a4c4-9ffb210dff6f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:50.296444 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c23b4cbe-1886-4c34-a4c4-9ffb210dff6f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:50.296870 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-c23b4cbe-1886-4c34-a4c4-9ffb210dff6f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:50.301793 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:50.437018 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-c23b4cbe-1886-4c34-a4c4-9ffb210dff6f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:50.445535 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-c23b4cbe-1886-4c34-a4c4-9ffb210dff6f tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1680 microversion: 2.1 time: 0.164702 Sep 01 17:44:50.446136 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 481/1003] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:50 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:51.468007 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-53ad7002-97fa-464b-bdfc-fe0f02dedb4e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:51.468612 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-53ad7002-97fa-464b-bdfc-fe0f02dedb4e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:51.471135 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:51.478426 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-53ad7002-97fa-464b-bdfc-fe0f02dedb4e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:51.479345 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-53ad7002-97fa-464b-bdfc-fe0f02dedb4e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:51.479959 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-53ad7002-97fa-464b-bdfc-fe0f02dedb4e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:51.480709 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-53ad7002-97fa-464b-bdfc-fe0f02dedb4e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:51.481120 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-53ad7002-97fa-464b-bdfc-fe0f02dedb4e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:51.481854 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-53ad7002-97fa-464b-bdfc-fe0f02dedb4e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:51.672414 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-53ad7002-97fa-464b-bdfc-fe0f02dedb4e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:51.682283 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-53ad7002-97fa-464b-bdfc-fe0f02dedb4e tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1680 microversion: 2.1 time: 0.219191 Sep 01 17:44:51.682872 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 523/1004] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:51 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:52.704127 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b439b715-0f06-4861-a7dc-bea660d4ca29 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:52.704770 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b439b715-0f06-4861-a7dc-bea660d4ca29 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:52.712433 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b439b715-0f06-4861-a7dc-bea660d4ca29 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:52.712950 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b439b715-0f06-4861-a7dc-bea660d4ca29 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:52.713483 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b439b715-0f06-4861-a7dc-bea660d4ca29 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:52.714212 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b439b715-0f06-4861-a7dc-bea660d4ca29 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:52.714837 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b439b715-0f06-4861-a7dc-bea660d4ca29 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:52.715429 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b439b715-0f06-4861-a7dc-bea660d4ca29 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:52.873053 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b439b715-0f06-4861-a7dc-bea660d4ca29 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:52.882853 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b439b715-0f06-4861-a7dc-bea660d4ca29 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1680 microversion: 2.1 time: 0.182474 Sep 01 17:44:52.883611 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 482/1005] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:52 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:44:53.905413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-33ed162a-7da9-437c-badb-5271da1bb7c3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:53.906056 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-33ed162a-7da9-437c-badb-5271da1bb7c3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:53.913392 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-33ed162a-7da9-437c-badb-5271da1bb7c3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:53.913915 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-33ed162a-7da9-437c-badb-5271da1bb7c3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:53.914352 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-33ed162a-7da9-437c-badb-5271da1bb7c3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:53.915055 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-33ed162a-7da9-437c-badb-5271da1bb7c3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:53.915510 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-33ed162a-7da9-437c-badb-5271da1bb7c3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:53.916220 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-33ed162a-7da9-437c-badb-5271da1bb7c3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:54.059716 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-33ed162a-7da9-437c-badb-5271da1bb7c3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:54.067646 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-33ed162a-7da9-437c-badb-5271da1bb7c3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1680 microversion: 2.1 time: 0.166039 Sep 01 17:44:54.068409 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 524/1006] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:53 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:55.089637 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-0953e981-d02e-4637-93ed-f47c2b8f1fd6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:55.090304 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-0953e981-d02e-4637-93ed-f47c2b8f1fd6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:55.096924 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0953e981-d02e-4637-93ed-f47c2b8f1fd6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:55.097411 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0953e981-d02e-4637-93ed-f47c2b8f1fd6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:55.098441 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0953e981-d02e-4637-93ed-f47c2b8f1fd6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:55.099453 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0953e981-d02e-4637-93ed-f47c2b8f1fd6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:55.100122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0953e981-d02e-4637-93ed-f47c2b8f1fd6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:55.100710 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-0953e981-d02e-4637-93ed-f47c2b8f1fd6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:55.250383 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-0953e981-d02e-4637-93ed-f47c2b8f1fd6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:55.258877 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-0953e981-d02e-4637-93ed-f47c2b8f1fd6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1680 microversion: 2.1 time: 0.173417 Sep 01 17:44:55.259597 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 483/1007] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:55 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:44:56.280337 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7b8c8b63-8ebb-4da9-8515-46b6c0e1962a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:56.280944 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7b8c8b63-8ebb-4da9-8515-46b6c0e1962a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:56.288392 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7b8c8b63-8ebb-4da9-8515-46b6c0e1962a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:56.288828 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7b8c8b63-8ebb-4da9-8515-46b6c0e1962a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:56.289323 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7b8c8b63-8ebb-4da9-8515-46b6c0e1962a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:56.290051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7b8c8b63-8ebb-4da9-8515-46b6c0e1962a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:56.290500 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7b8c8b63-8ebb-4da9-8515-46b6c0e1962a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:56.291186 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7b8c8b63-8ebb-4da9-8515-46b6c0e1962a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:56.430401 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-7b8c8b63-8ebb-4da9-8515-46b6c0e1962a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:56.438089 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7b8c8b63-8ebb-4da9-8515-46b6c0e1962a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1657 microversion: 2.1 time: 0.161661 Sep 01 17:44:56.438657 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 525/1008] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:56 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1657 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:56.459143 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-06594fd4-9320-4dce-96bd-ce5edbfa2458 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:56.465757 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06594fd4-9320-4dce-96bd-ce5edbfa2458 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:56.466245 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06594fd4-9320-4dce-96bd-ce5edbfa2458 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:56.466683 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-06594fd4-9320-4dce-96bd-ce5edbfa2458 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:56.538123 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-06594fd4-9320-4dce-96bd-ce5edbfa2458 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Going to try to start instance {{(pid=127232) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 17:44:56.596631 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-06594fd4-9320-4dce-96bd-ce5edbfa2458 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "POST /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/action" status: 202 len: 0 microversion: 2.1 time: 0.141354 Sep 01 17:44:56.597398 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 484/1009] 10.222.0.100 () {60 vars in 1283 bytes} [Thu Sep 1 17:44:56 2022] POST /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:44:56.607493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8a10d3ed-7200-4b42-9ac0-b2fe35ab7a9b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:56.608334 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8a10d3ed-7200-4b42-9ac0-b2fe35ab7a9b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:56.615736 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8a10d3ed-7200-4b42-9ac0-b2fe35ab7a9b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:56.616674 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8a10d3ed-7200-4b42-9ac0-b2fe35ab7a9b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:56.617425 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8a10d3ed-7200-4b42-9ac0-b2fe35ab7a9b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:56.618223 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8a10d3ed-7200-4b42-9ac0-b2fe35ab7a9b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:56.619290 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8a10d3ed-7200-4b42-9ac0-b2fe35ab7a9b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:56.620266 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8a10d3ed-7200-4b42-9ac0-b2fe35ab7a9b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:56.890050 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8a10d3ed-7200-4b42-9ac0-b2fe35ab7a9b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:56.899156 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8a10d3ed-7200-4b42-9ac0-b2fe35ab7a9b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1666 microversion: 2.1 time: 0.295847 Sep 01 17:44:56.899794 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 526/1010] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:56 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1666 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:57.922741 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5b1e960f-b5f1-4d23-ac5b-24679aacb726 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:57.923444 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5b1e960f-b5f1-4d23-ac5b-24679aacb726 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:57.930549 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5b1e960f-b5f1-4d23-ac5b-24679aacb726 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:57.931040 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5b1e960f-b5f1-4d23-ac5b-24679aacb726 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:57.931477 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5b1e960f-b5f1-4d23-ac5b-24679aacb726 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:57.932174 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5b1e960f-b5f1-4d23-ac5b-24679aacb726 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:57.932825 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5b1e960f-b5f1-4d23-ac5b-24679aacb726 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:57.933408 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5b1e960f-b5f1-4d23-ac5b-24679aacb726 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:58.079085 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5b1e960f-b5f1-4d23-ac5b-24679aacb726 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:58.089004 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5b1e960f-b5f1-4d23-ac5b-24679aacb726 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1666 microversion: 2.1 time: 0.170540 Sep 01 17:44:58.089348 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 485/1011] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:57 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1666 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:59.115131 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4047c5f9-3603-400d-b767-e0f8d01be0e6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:59.116171 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4047c5f9-3603-400d-b767-e0f8d01be0e6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:59.125386 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4047c5f9-3603-400d-b767-e0f8d01be0e6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:59.125933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4047c5f9-3603-400d-b767-e0f8d01be0e6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:59.126720 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4047c5f9-3603-400d-b767-e0f8d01be0e6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:59.127471 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4047c5f9-3603-400d-b767-e0f8d01be0e6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:59.127970 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4047c5f9-3603-400d-b767-e0f8d01be0e6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:59.128400 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4047c5f9-3603-400d-b767-e0f8d01be0e6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:59.273092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-4047c5f9-3603-400d-b767-e0f8d01be0e6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:59.280885 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4047c5f9-3603-400d-b767-e0f8d01be0e6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1670 microversion: 2.1 time: 0.172461 Sep 01 17:44:59.281458 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 527/1012] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:59 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:37.994560 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-15a395bc-32d8-4de6-8d88-25d63ab771e3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:37.996888 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-15a395bc-32d8-4de6-8d88-25d63ab771e3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:38.006355 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=9 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:38.008896 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:38.012497 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 01 17:45:38.019801 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-15a395bc-32d8-4de6-8d88-25d63ab771e3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:38.020234 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-15a395bc-32d8-4de6-8d88-25d63ab771e3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:38.025323 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-15a395bc-32d8-4de6-8d88-25d63ab771e3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:38.026485 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-15a395bc-32d8-4de6-8d88-25d63ab771e3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:38.027133 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-15a395bc-32d8-4de6-8d88-25d63ab771e3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:38.027732 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-15a395bc-32d8-4de6-8d88-25d63ab771e3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:38.082989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-15a395bc-32d8-4de6-8d88-25d63ab771e3 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092105 Sep 01 17:45:38.084001 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 486/1013] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:45:37 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 17:45:38.164581 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6ffe23d9-8020-445d-a86f-49d03159a611 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:38.165088 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6ffe23d9-8020-445d-a86f-49d03159a611 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:38.171732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=9 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:38.172863 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=30 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:38.176729 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6ffe23d9-8020-445d-a86f-49d03159a611 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:38.178235 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6ffe23d9-8020-445d-a86f-49d03159a611 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:38.179263 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6ffe23d9-8020-445d-a86f-49d03159a611 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:38.180205 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6ffe23d9-8020-445d-a86f-49d03159a611 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:38.180898 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6ffe23d9-8020-445d-a86f-49d03159a611 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:38.181498 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6ffe23d9-8020-445d-a86f-49d03159a611 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:38.221376 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6ffe23d9-8020-445d-a86f-49d03159a611 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Going to try to terminate instance {{(pid=127233) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:45:38.317793 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-6ffe23d9-8020-445d-a86f-49d03159a611 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "DELETE /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 204 len: 0 microversion: 2.1 time: 0.156689 Sep 01 17:45:38.322109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 528/1014] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:45:38 2022] DELETE /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:45:38.330376 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-806421d7-31ee-4076-9759-6ca61537c7aa tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:38.331806 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-806421d7-31ee-4076-9759-6ca61537c7aa tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:38.360077 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-806421d7-31ee-4076-9759-6ca61537c7aa tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:38.362256 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-806421d7-31ee-4076-9759-6ca61537c7aa tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:38.362862 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-806421d7-31ee-4076-9759-6ca61537c7aa tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:38.366152 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-806421d7-31ee-4076-9759-6ca61537c7aa tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:38.369115 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-806421d7-31ee-4076-9759-6ca61537c7aa tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:38.369927 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-806421d7-31ee-4076-9759-6ca61537c7aa tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:38.760264 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-806421d7-31ee-4076-9759-6ca61537c7aa tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:38.768578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-806421d7-31ee-4076-9759-6ca61537c7aa tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1676 microversion: 2.1 time: 0.444854 Sep 01 17:45:38.769151 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 487/1015] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:38 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1676 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:39.795590 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-dd1def85-66a0-43a8-9c5f-f4dd1e0eec03 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:39.797178 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-dd1def85-66a0-43a8-9c5f-f4dd1e0eec03 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:39.806177 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dd1def85-66a0-43a8-9c5f-f4dd1e0eec03 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:39.806946 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dd1def85-66a0-43a8-9c5f-f4dd1e0eec03 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:39.807603 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dd1def85-66a0-43a8-9c5f-f4dd1e0eec03 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:39.808558 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dd1def85-66a0-43a8-9c5f-f4dd1e0eec03 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:39.809219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dd1def85-66a0-43a8-9c5f-f4dd1e0eec03 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:39.810142 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-dd1def85-66a0-43a8-9c5f-f4dd1e0eec03 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:39.963639 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-dd1def85-66a0-43a8-9c5f-f4dd1e0eec03 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:39.980027 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-dd1def85-66a0-43a8-9c5f-f4dd1e0eec03 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1676 microversion: 2.1 time: 0.188981 Sep 01 17:45:39.980605 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 488/1016] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:39 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:40.007168 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7035fe75-f4db-4693-9368-acae5f7343f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Action: 'create', calling method: .version_select at 0x7f354a8630d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-398492581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr9I3b0o9TCodVcxbdrm7NiYzZvg9WiHtbKutc9KQdrsVJkjiTu8OJph0BvaJKE/LYDglk1drJDaqKjuDhejuy10hBeRS+inKTjExY5GRKNTO/SfYPvN9+jTWJU7xP35A=="}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:45:40.026921 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-7035fe75-f4db-4693-9368-acae5f7343f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Getting quotas for project 2e0189e8a6ef4f2c930f0864100a9d82. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:45:40.031479 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-7035fe75-f4db-4693-9368-acae5f7343f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Getting quotas for user cf0dc05b996e4aa3a1d7605028c64f30 and project 2e0189e8a6ef4f2c930f0864100a9d82. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:45:40.056206 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7035fe75-f4db-4693-9368-acae5f7343f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.321611 Sep 01 17:45:40.056818 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 529/1017] 10.222.0.100 () {60 vars in 1164 bytes} [Thu Sep 1 17:45:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:45:41.005404 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-30fe0cf4-ce60-4317-a84a-17702d31d5e0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:41.006233 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-30fe0cf4-ce60-4317-a84a-17702d31d5e0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:41.020593 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-30fe0cf4-ce60-4317-a84a-17702d31d5e0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:41.021486 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-30fe0cf4-ce60-4317-a84a-17702d31d5e0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:41.022167 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-30fe0cf4-ce60-4317-a84a-17702d31d5e0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:41.023192 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-30fe0cf4-ce60-4317-a84a-17702d31d5e0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:41.023860 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-30fe0cf4-ce60-4317-a84a-17702d31d5e0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:41.024528 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-30fe0cf4-ce60-4317-a84a-17702d31d5e0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:41.241406 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-30fe0cf4-ce60-4317-a84a-17702d31d5e0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:41.267046 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-30fe0cf4-ce60-4317-a84a-17702d31d5e0 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1676 microversion: 2.1 time: 0.268296 Sep 01 17:45:41.269081 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 489/1018] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:40 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1676 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:41.711292 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-9e6d4b73-7a46-45f4-a174-5813eb7ab4a2 req-40330ff3-e53a-4113-ab07-ff05a5586ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad71e4c-acb3-4e98-a9a4-5cd212974512", "name": "network-vif-deleted", "tag": "a6a8f7cf-5950-4c1e-81cb-c7f8526a0e9f"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:45:41.744961 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-9e6d4b73-7a46-45f4-a174-5813eb7ab4a2 req-40330ff3-e53a-4113-ab07-ff05a5586ee3 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:41.745692 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-9e6d4b73-7a46-45f4-a174-5813eb7ab4a2 req-40330ff3-e53a-4113-ab07-ff05a5586ee3 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:41.746137 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-9e6d4b73-7a46-45f4-a174-5813eb7ab4a2 req-40330ff3-e53a-4113-ab07-ff05a5586ee3 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:41.759396 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-9e6d4b73-7a46-45f4-a174-5813eb7ab4a2 req-40330ff3-e53a-4113-ab07-ff05a5586ee3 service nova] Creating event network-vif-deleted:a6a8f7cf-5950-4c1e-81cb-c7f8526a0e9f for instance bad71e4c-acb3-4e98-a9a4-5cd212974512 on hv-cinder-83976 Sep 01 17:45:41.771891 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-9e6d4b73-7a46-45f4-a174-5813eb7ab4a2 req-40330ff3-e53a-4113-ab07-ff05a5586ee3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066067 Sep 01 17:45:41.784241 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 530/1019] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:45:42.308893 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:42.311268 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:42.341426 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:42.344284 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:42.346186 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:42.348747 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:42.349822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:42.350595 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:42.440578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:42.441074 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:42.442949 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:42.443889 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lazy-loading 'fault' on Instance uuid bad71e4c-acb3-4e98-a9a4-5cd212974512 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:45:42.522414 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:42.550038 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-57cb8930-b348-4f44-96b8-44b3c4afdce1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 200 len: 1331 microversion: 2.1 time: 0.251734 Sep 01 17:45:42.555619 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 490/1020] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:42 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 1331 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:43.577565 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-72e7092b-f397-4527-8c65-02cab1a98467 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:43.578351 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-72e7092b-f397-4527-8c65-02cab1a98467 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:43.585110 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-72e7092b-f397-4527-8c65-02cab1a98467 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:43.585614 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-72e7092b-f397-4527-8c65-02cab1a98467 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:43.586261 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-72e7092b-f397-4527-8c65-02cab1a98467 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:43.586967 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-72e7092b-f397-4527-8c65-02cab1a98467 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:43.587417 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-72e7092b-f397-4527-8c65-02cab1a98467 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:43.587837 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-72e7092b-f397-4527-8c65-02cab1a98467 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:43.602543 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-72e7092b-f397-4527-8c65-02cab1a98467 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] HTTP exception thrown: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-72e7092b-f397-4527-8c65-02cab1a98467 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Request method failure captured: Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 HTTP/1.1 Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO8Kg8DO_3jKdfaMS8P29gwjXrsYt-5Fceowvj__gfDyuBRB3gC4MUUyE64icIHkc_37P9NTn29NY7uMZZnW0zXubVc4ChoXMGBlS0IGtn_FsfsZw1eLys7qwUW5Yw0_6fh6Xq0DNupgfT8tSeLxAKlFcLWF1cPREKylIl4DiPpDtH0 Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 8cdeb9d9f0eb4f1c805502bb30a99ebc Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:45:43.604413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:45:43.606114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:45:43.606114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:45:43.606114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 8cdeb9d9f0eb4f1c805502bb30a99ebc Sep 01 17:45:43.606114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:45:43.606114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-AttachVolumeTestJSON-274265072-project Sep 01 17:45:43.606114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:45:43.606114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:45:43.606114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: d8259269a28a401eb4ddbe90f128fe71 Sep 01 17:45:43.606114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-AttachVolumeTestJSON-274265072-project Sep 01 17:45:43.606114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:45:43.606114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:45:43.606114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': 'bad71e4c-acb3-4e98-a9a4-5cd212974512'} Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:45:43.607019 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:45:43.608768 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:45:43.610198 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-72e7092b-f397-4527-8c65-02cab1a98467 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Returning 404 to user: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:45:43.610198 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-72e7092b-f397-4527-8c65-02cab1a98467 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 404 len: 111 microversion: 2.1 time: 0.033593 Sep 01 17:45:43.610198 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 531/1021] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:43 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:45:43.617688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4e76086a-d25c-4c18-9d52-d9cc0d19a3e1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '.version_select at 0x7f354dedd1f0>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:43.640353 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4e76086a-d25c-4c18-9d52-d9cc0d19a3e1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150872533" status: 202 len: 0 microversion: 2.1 time: 0.028371 Sep 01 17:45:43.641164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 491/1022] 10.222.0.100 () {58 vars in 1226 bytes} [Thu Sep 1 17:45:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150872533 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:45:44.357927 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1a7c7826-c708-4565-8bdb-6eb7c2096aa2 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Action: 'create', calling method: .version_select at 0x7f354a653ee0>, body: {"keypair": {"name": "tempest-keypair-639296043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOlgXAn7aU0HZXVn6ibiSjHVfm7vJ+s9RvB7aIEqpjnPXuw1SwdDPIRzz+CHHpsPSZi+bHhG1aCEonyrKjosQm/eHbaCS92YCp5k13H9TnJXEjb+rgqyFJ2TyTduxAbhQ=="}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:45:44.378257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-1a7c7826-c708-4565-8bdb-6eb7c2096aa2 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Getting quotas for project 8cdeb9d9f0eb4f1c805502bb30a99ebc. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:45:44.383891 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-1a7c7826-c708-4565-8bdb-6eb7c2096aa2 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Getting quotas for user d8259269a28a401eb4ddbe90f128fe71 and project 8cdeb9d9f0eb4f1c805502bb30a99ebc. Resources: {'key_pairs'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:45:44.417113 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1a7c7826-c708-4565-8bdb-6eb7c2096aa2 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063209 Sep 01 17:45:44.418792 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 532/1023] 10.222.0.100 () {60 vars in 1164 bytes} [Thu Sep 1 17:45:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:45:46.101739 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1624349415", "imageRef": "c9746591-f2e9-421a-834d-1a30ece857e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec721b63-de0a-41b2-95e9-34f0275fa6c8"}], "security_groups": [{"name": "tempest-securitygroup--100021637"}], "key_name": "tempest-keypair-639296043", "user_data": "}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:45:46.218169 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.network.neutron [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] validate_networks() for [('ec721b63-de0a-41b2-95e9-34f0275fa6c8', None, None, None, None, None)] {{(pid=127232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:45:46.614551 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Flavor limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:45:46.614977 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Image limits 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:45:46.615450 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Flavor pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:45:46.615858 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Image pref 0:0:0 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:45:46.616294 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.virt.hardware [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:45:46.625096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:46.625588 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:46.626034 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:46.626765 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:46.627221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:46.627639 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:46.647038 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Getting quotas for project 8cdeb9d9f0eb4f1c805502bb30a99ebc. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:45:46.651093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.quota [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Getting quotas for user d8259269a28a401eb4ddbe90f128fe71 and project 8cdeb9d9f0eb4f1c805502bb30a99ebc. Resources: {'ram', 'instances', 'cores'} {{(pid=127232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:45:46.663731 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Going to run 1 instances... {{(pid=127232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:45:46.666077 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9746591-f2e9-421a-834d-1a30ece857e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:45:46.715978 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8534c6da-d83f-4ec1-b87a-31a8a0b5eeab tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.619740 Sep 01 17:45:46.716861 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 492/1024] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:45:46 2022] POST /compute/v2.1/servers => generated 403 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:45:46.727742 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a05f77fc-ff5e-4293-a81b-fc35d5772b08 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:46.728509 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a05f77fc-ff5e-4293-a81b-fc35d5772b08 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:46.789714 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a05f77fc-ff5e-4293-a81b-fc35d5772b08 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:46.799310 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a05f77fc-ff5e-4293-a81b-fc35d5772b08 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1241 microversion: 2.1 time: 0.074741 Sep 01 17:45:46.800037 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 533/1025] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:46 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:45:47.825016 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-eb418f69-bb6f-4913-a206-910b2414b911 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:47.825668 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-eb418f69-bb6f-4913-a206-910b2414b911 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:47.836394 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb418f69-bb6f-4913-a206-910b2414b911 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:47.836891 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb418f69-bb6f-4913-a206-910b2414b911 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:47.838014 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb418f69-bb6f-4913-a206-910b2414b911 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:47.838755 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb418f69-bb6f-4913-a206-910b2414b911 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:47.839216 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb418f69-bb6f-4913-a206-910b2414b911 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:47.840296 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-eb418f69-bb6f-4913-a206-910b2414b911 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:47.929546 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-eb418f69-bb6f-4913-a206-910b2414b911 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:47.937939 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-eb418f69-bb6f-4913-a206-910b2414b911 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1311 microversion: 2.1 time: 0.117354 Sep 01 17:45:47.938523 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 493/1026] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:47 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1311 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:48.959858 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-e8310ab5-cc41-4c03-9976-b5843d70f4da tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:48.960391 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-e8310ab5-cc41-4c03-9976-b5843d70f4da tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:48.967343 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e8310ab5-cc41-4c03-9976-b5843d70f4da tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:48.967966 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e8310ab5-cc41-4c03-9976-b5843d70f4da tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:48.968413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e8310ab5-cc41-4c03-9976-b5843d70f4da tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:48.969108 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e8310ab5-cc41-4c03-9976-b5843d70f4da tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:48.969557 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e8310ab5-cc41-4c03-9976-b5843d70f4da tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:48.970011 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-e8310ab5-cc41-4c03-9976-b5843d70f4da tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:49.216694 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-e8310ab5-cc41-4c03-9976-b5843d70f4da tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:49.224849 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-e8310ab5-cc41-4c03-9976-b5843d70f4da tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1366 microversion: 2.1 time: 0.269727 Sep 01 17:45:49.225400 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 534/1027] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:48 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:45:49.328170 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-b71273d4-cf5a-4d74-b131-d38a844a8dcb req-1d2cfc50-32e4-4cce-9017-0f036a2d00db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ca8574-a9e1-4b07-819f-e8199ba59322", "tag": "33eaf352-5499-4fb6-9dda-e9292ec8b809"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:45:49.339606 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-b71273d4-cf5a-4d74-b131-d38a844a8dcb req-1d2cfc50-32e4-4cce-9017-0f036a2d00db service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:49.340168 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-b71273d4-cf5a-4d74-b131-d38a844a8dcb req-1d2cfc50-32e4-4cce-9017-0f036a2d00db service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:49.340601 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-b71273d4-cf5a-4d74-b131-d38a844a8dcb req-1d2cfc50-32e4-4cce-9017-0f036a2d00db service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:49.357280 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-b71273d4-cf5a-4d74-b131-d38a844a8dcb req-1d2cfc50-32e4-4cce-9017-0f036a2d00db service nova] Creating event network-changed:33eaf352-5499-4fb6-9dda-e9292ec8b809 for instance 27ca8574-a9e1-4b07-819f-e8199ba59322 on hv-cinder-83976 Sep 01 17:45:49.362754 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-b71273d4-cf5a-4d74-b131-d38a844a8dcb req-1d2cfc50-32e4-4cce-9017-0f036a2d00db service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038205 Sep 01 17:45:49.363261 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 494/1028] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:45:50.247853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1a3e730b-9880-4226-9453-e85396186386 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:50.248387 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-1a3e730b-9880-4226-9453-e85396186386 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:50.254946 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1a3e730b-9880-4226-9453-e85396186386 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:50.255445 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1a3e730b-9880-4226-9453-e85396186386 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:50.255873 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1a3e730b-9880-4226-9453-e85396186386 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:50.256589 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1a3e730b-9880-4226-9453-e85396186386 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:50.257055 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1a3e730b-9880-4226-9453-e85396186386 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:50.257483 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1a3e730b-9880-4226-9453-e85396186386 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:50.397533 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-1a3e730b-9880-4226-9453-e85396186386 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:50.406468 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1a3e730b-9880-4226-9453-e85396186386 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1366 microversion: 2.1 time: 0.162475 Sep 01 17:45:50.407066 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 535/1029] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:50 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:51.428733 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-7c69decc-30c9-4d5e-81e6-0e6f98fdd3d6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:51.429426 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-7c69decc-30c9-4d5e-81e6-0e6f98fdd3d6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:51.436794 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7c69decc-30c9-4d5e-81e6-0e6f98fdd3d6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:51.437209 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7c69decc-30c9-4d5e-81e6-0e6f98fdd3d6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:51.437683 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7c69decc-30c9-4d5e-81e6-0e6f98fdd3d6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:51.438403 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7c69decc-30c9-4d5e-81e6-0e6f98fdd3d6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:51.438864 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7c69decc-30c9-4d5e-81e6-0e6f98fdd3d6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:51.439296 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-7c69decc-30c9-4d5e-81e6-0e6f98fdd3d6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:51.576583 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-7c69decc-30c9-4d5e-81e6-0e6f98fdd3d6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:51.585120 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-7c69decc-30c9-4d5e-81e6-0e6f98fdd3d6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1366 microversion: 2.1 time: 0.161222 Sep 01 17:45:51.585703 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 495/1030] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:51 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:52.606790 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-cb362062-597f-4419-b037-b32df0979c75 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:52.607403 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-cb362062-597f-4419-b037-b32df0979c75 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:52.614718 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb362062-597f-4419-b037-b32df0979c75 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:52.615199 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb362062-597f-4419-b037-b32df0979c75 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:52.615633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb362062-597f-4419-b037-b32df0979c75 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:52.616327 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb362062-597f-4419-b037-b32df0979c75 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:52.616779 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb362062-597f-4419-b037-b32df0979c75 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:52.617197 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-cb362062-597f-4419-b037-b32df0979c75 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:52.760043 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-cb362062-597f-4419-b037-b32df0979c75 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:52.767868 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-cb362062-597f-4419-b037-b32df0979c75 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1366 microversion: 2.1 time: 0.164965 Sep 01 17:45:52.768457 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 536/1031] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:52 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:45:53.789215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-141d5058-7778-4129-b820-cd675b5161eb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:53.789844 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-141d5058-7778-4129-b820-cd675b5161eb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:53.796512 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-141d5058-7778-4129-b820-cd675b5161eb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:53.796995 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-141d5058-7778-4129-b820-cd675b5161eb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:53.797431 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-141d5058-7778-4129-b820-cd675b5161eb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:53.798160 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-141d5058-7778-4129-b820-cd675b5161eb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:53.798633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-141d5058-7778-4129-b820-cd675b5161eb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:53.799038 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-141d5058-7778-4129-b820-cd675b5161eb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:53.930778 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-141d5058-7778-4129-b820-cd675b5161eb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:53.938543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-141d5058-7778-4129-b820-cd675b5161eb tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1366 microversion: 2.1 time: 0.153864 Sep 01 17:45:53.939099 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 496/1032] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:53 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:54.959833 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-86dfac7f-52fc-49c5-832f-b3972d31d8fe tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:54.960562 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-86dfac7f-52fc-49c5-832f-b3972d31d8fe tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:54.966981 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86dfac7f-52fc-49c5-832f-b3972d31d8fe tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:54.967462 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86dfac7f-52fc-49c5-832f-b3972d31d8fe tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:54.967897 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86dfac7f-52fc-49c5-832f-b3972d31d8fe tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:54.968591 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86dfac7f-52fc-49c5-832f-b3972d31d8fe tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:54.969045 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86dfac7f-52fc-49c5-832f-b3972d31d8fe tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:54.969498 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-86dfac7f-52fc-49c5-832f-b3972d31d8fe tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:55.104902 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-86dfac7f-52fc-49c5-832f-b3972d31d8fe tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:55.112753 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-86dfac7f-52fc-49c5-832f-b3972d31d8fe tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1366 microversion: 2.1 time: 0.157323 Sep 01 17:45:55.113313 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 537/1033] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:54 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:55.543140 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-90d814b4-8335-499b-8edf-a4814bd133fe req-5738aede-bb61-458b-850c-b6781a4b69dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ca8574-a9e1-4b07-819f-e8199ba59322", "name": "network-vif-plugged", "status": "completed", "tag": "33eaf352-5499-4fb6-9dda-e9292ec8b809"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:45:55.553484 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-90d814b4-8335-499b-8edf-a4814bd133fe req-5738aede-bb61-458b-850c-b6781a4b69dc service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:55.554135 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-90d814b4-8335-499b-8edf-a4814bd133fe req-5738aede-bb61-458b-850c-b6781a4b69dc service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:55.554776 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-90d814b4-8335-499b-8edf-a4814bd133fe req-5738aede-bb61-458b-850c-b6781a4b69dc service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:55.567383 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-90d814b4-8335-499b-8edf-a4814bd133fe req-5738aede-bb61-458b-850c-b6781a4b69dc service nova] Creating event network-vif-plugged:33eaf352-5499-4fb6-9dda-e9292ec8b809 for instance 27ca8574-a9e1-4b07-819f-e8199ba59322 on hv-cinder-83976 Sep 01 17:45:55.572571 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-90d814b4-8335-499b-8edf-a4814bd133fe req-5738aede-bb61-458b-850c-b6781a4b69dc service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033336 Sep 01 17:45:55.573163 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 497/1034] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:45:56.133542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-05c5239f-fd6a-41ea-a73f-b98ef91cecf7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:56.134180 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-05c5239f-fd6a-41ea-a73f-b98ef91cecf7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:56.140570 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05c5239f-fd6a-41ea-a73f-b98ef91cecf7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:56.141052 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05c5239f-fd6a-41ea-a73f-b98ef91cecf7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:56.141488 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05c5239f-fd6a-41ea-a73f-b98ef91cecf7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:56.142208 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05c5239f-fd6a-41ea-a73f-b98ef91cecf7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:56.142667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05c5239f-fd6a-41ea-a73f-b98ef91cecf7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:56.143089 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-05c5239f-fd6a-41ea-a73f-b98ef91cecf7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:56.279533 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-05c5239f-fd6a-41ea-a73f-b98ef91cecf7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:56.287905 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-05c5239f-fd6a-41ea-a73f-b98ef91cecf7 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1366 microversion: 2.1 time: 0.158243 Sep 01 17:45:56.288470 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 538/1035] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:56 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:57.306002 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:57.306941 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=6 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:57.311115 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-953bbfc0-307a-4241-82dc-98186a540a89 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:57.311816 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-953bbfc0-307a-4241-82dc-98186a540a89 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:57.319576 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-953bbfc0-307a-4241-82dc-98186a540a89 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:57.320060 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-953bbfc0-307a-4241-82dc-98186a540a89 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:57.320494 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-953bbfc0-307a-4241-82dc-98186a540a89 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:57.321197 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-953bbfc0-307a-4241-82dc-98186a540a89 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:57.321686 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-953bbfc0-307a-4241-82dc-98186a540a89 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:57.322114 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-953bbfc0-307a-4241-82dc-98186a540a89 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:57.458797 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-953bbfc0-307a-4241-82dc-98186a540a89 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:57.466675 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-953bbfc0-307a-4241-82dc-98186a540a89 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1366 microversion: 2.1 time: 0.162039 Sep 01 17:45:57.467258 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 498/1036] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:57 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:57.860395 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-270414838", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-398492581", "security_groups": [{"name": "tempest-secgroup-smoke-629838131"}], "block_device_mapping_v2": [{"uuid": "f78b50e9-a3c9-4041-9733-e79875dfa24d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "35671c59-ec30-4d34-bd86-c3e22ee22f08"}]}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:45:57.872092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=10 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:57.977247 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.network.neutron [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] validate_networks() for [('35671c59-ec30-4d34-bd86-c3e22ee22f08', None, None, None, None, None)] {{(pid=127233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:45:58.351063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Flavor limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:45:58.351493 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Image limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:45:58.351972 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Flavor pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:45:58.352379 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Image pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:45:58.352821 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:45:58.361732 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:58.362241 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:58.362696 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:58.363438 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:58.364451 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:58.365008 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:58.381475 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Getting quotas for project 2e0189e8a6ef4f2c930f0864100a9d82. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:45:58.385447 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Getting quotas for user cf0dc05b996e4aa3a1d7605028c64f30 and project 2e0189e8a6ef4f2c930f0864100a9d82. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:45:58.442828 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Going to run 1 instances... {{(pid=127233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:45:58.444991 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f78b50e9-a3c9-4041-9733-e79875dfa24d',volume_size=None,volume_type=None)] {{(pid=127233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:45:58.489527 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-33e38b9a-ed78-47e3-a606-ee5fa838e53d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:58.490309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-33e38b9a-ed78-47e3-a606-ee5fa838e53d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:58.497201 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-33e38b9a-ed78-47e3-a606-ee5fa838e53d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:58.497810 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-33e38b9a-ed78-47e3-a606-ee5fa838e53d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:58.498254 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-33e38b9a-ed78-47e3-a606-ee5fa838e53d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:58.498966 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-33e38b9a-ed78-47e3-a606-ee5fa838e53d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:58.499430 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-33e38b9a-ed78-47e3-a606-ee5fa838e53d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:58.499865 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-33e38b9a-ed78-47e3-a606-ee5fa838e53d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:58.578369 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR oslo.messaging._drivers.impl_rabbit [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [da037172-faa6-455e-9ce3-831f18435deb] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 17:45:58.643415 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-33e38b9a-ed78-47e3-a606-ee5fa838e53d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:58.651582 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-33e38b9a-ed78-47e3-a606-ee5fa838e53d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1551 microversion: 2.1 time: 0.166383 Sep 01 17:45:58.652148 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 499/1037] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:58 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:45:58.672859 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-30c4ca6d-aa6e-4208-8845-1d7a561719a4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:58.673345 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-30c4ca6d-aa6e-4208-8845-1d7a561719a4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:58.679246 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-30c4ca6d-aa6e-4208-8845-1d7a561719a4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:58.679719 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-30c4ca6d-aa6e-4208-8845-1d7a561719a4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:58.680147 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-30c4ca6d-aa6e-4208-8845-1d7a561719a4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:58.680827 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-30c4ca6d-aa6e-4208-8845-1d7a561719a4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:45:58.681277 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-30c4ca6d-aa6e-4208-8845-1d7a561719a4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:45:58.681726 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-30c4ca6d-aa6e-4208-8845-1d7a561719a4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:45:58.759935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-30c4ca6d-aa6e-4208-8845-1d7a561719a4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090833 Sep 01 17:45:58.760587 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 500/1038] 10.222.0.100 () {58 vars in 1280 bytes} [Thu Sep 1 17:45:58 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:45:59.587449 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO oslo.messaging._drivers.impl_rabbit [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [da037172-faa6-455e-9ce3-831f18435deb] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 46962. Sep 01 17:45:59.592139 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-14a66f65-02db-4cf2-8449-8776fc0202d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.735546 Sep 01 17:45:59.592796 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 539/1039] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:45:57 2022] POST /compute/v2.1/servers => generated 407 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:45:59.605898 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5b57da19-5155-4923-a9fb-01bc6f5cb76b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:45:59.606512 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5b57da19-5155-4923-a9fb-01bc6f5cb76b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:45:59.669804 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5b57da19-5155-4923-a9fb-01bc6f5cb76b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:45:59.676705 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5b57da19-5155-4923-a9fb-01bc6f5cb76b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1096 microversion: 2.1 time: 0.075451 Sep 01 17:45:59.677970 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 501/1040] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:45:59 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1096 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:59.993621 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-68a8b55c-816f-4693-bd28-2c7d1ec4106f req-c8bf8d0a-615a-4e30-832c-2946fe5e2fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ca8574-a9e1-4b07-819f-e8199ba59322", "tag": "33eaf352-5499-4fb6-9dda-e9292ec8b809"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:00.003090 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-68a8b55c-816f-4693-bd28-2c7d1ec4106f req-c8bf8d0a-615a-4e30-832c-2946fe5e2fd3 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:00.003659 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-68a8b55c-816f-4693-bd28-2c7d1ec4106f req-c8bf8d0a-615a-4e30-832c-2946fe5e2fd3 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:00.003981 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-68a8b55c-816f-4693-bd28-2c7d1ec4106f req-c8bf8d0a-615a-4e30-832c-2946fe5e2fd3 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:00.015138 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-68a8b55c-816f-4693-bd28-2c7d1ec4106f req-c8bf8d0a-615a-4e30-832c-2946fe5e2fd3 service nova] Creating event network-changed:33eaf352-5499-4fb6-9dda-e9292ec8b809 for instance 27ca8574-a9e1-4b07-819f-e8199ba59322 on hv-cinder-83976 Sep 01 17:46:00.020760 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-68a8b55c-816f-4693-bd28-2c7d1ec4106f req-c8bf8d0a-615a-4e30-832c-2946fe5e2fd3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031238 Sep 01 17:46:00.021858 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 540/1041] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:00.698881 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-1487c644-47ed-49c2-9f08-e74ed5fdeabb tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:00.699946 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-1487c644-47ed-49c2-9f08-e74ed5fdeabb tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:00.756241 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1487c644-47ed-49c2-9f08-e74ed5fdeabb tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:00.763097 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-1487c644-47ed-49c2-9f08-e74ed5fdeabb tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1096 microversion: 2.1 time: 0.068412 Sep 01 17:46:00.763654 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 502/1042] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:00 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1096 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:01.784561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-19ea3269-ccbf-4713-8065-b08accf9ee4d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:01.785350 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-19ea3269-ccbf-4713-8065-b08accf9ee4d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:01.843075 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-19ea3269-ccbf-4713-8065-b08accf9ee4d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:01.850269 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-19ea3269-ccbf-4713-8065-b08accf9ee4d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1096 microversion: 2.1 time: 0.070306 Sep 01 17:46:01.850840 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 541/1043] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:01 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1096 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:02.871221 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-af0d8d20-5829-4950-9394-50e1d1734f08 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:02.871837 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-af0d8d20-5829-4950-9394-50e1d1734f08 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:02.929144 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-af0d8d20-5829-4950-9394-50e1d1734f08 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:02.936124 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-af0d8d20-5829-4950-9394-50e1d1734f08 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1096 microversion: 2.1 time: 0.068970 Sep 01 17:46:02.936693 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 503/1044] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:02 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1096 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:03.956403 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b320333c-2a73-4f7f-bc7b-c00a8009a40f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:03.956979 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-b320333c-2a73-4f7f-bc7b-c00a8009a40f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:03.964401 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b320333c-2a73-4f7f-bc7b-c00a8009a40f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:03.964890 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b320333c-2a73-4f7f-bc7b-c00a8009a40f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:03.965326 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b320333c-2a73-4f7f-bc7b-c00a8009a40f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:03.966051 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b320333c-2a73-4f7f-bc7b-c00a8009a40f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:03.966508 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b320333c-2a73-4f7f-bc7b-c00a8009a40f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:03.966930 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b320333c-2a73-4f7f-bc7b-c00a8009a40f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:04.027575 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-b320333c-2a73-4f7f-bc7b-c00a8009a40f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:04.035268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-b320333c-2a73-4f7f-bc7b-c00a8009a40f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1146 microversion: 2.1 time: 0.082789 Sep 01 17:46:04.035836 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 542/1045] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:03 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1146 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:05.058523 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-35462a17-6e13-4322-8327-16b66807ccc2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:05.059141 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-35462a17-6e13-4322-8327-16b66807ccc2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:05.073234 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-35462a17-6e13-4322-8327-16b66807ccc2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:05.073769 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-35462a17-6e13-4322-8327-16b66807ccc2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:05.074216 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-35462a17-6e13-4322-8327-16b66807ccc2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:05.074934 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-35462a17-6e13-4322-8327-16b66807ccc2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:05.075391 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-35462a17-6e13-4322-8327-16b66807ccc2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:05.075817 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-35462a17-6e13-4322-8327-16b66807ccc2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:05.164456 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-35462a17-6e13-4322-8327-16b66807ccc2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:05.175381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-35462a17-6e13-4322-8327-16b66807ccc2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1212 microversion: 2.1 time: 0.120116 Sep 01 17:46:05.176194 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 504/1046] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:05 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1212 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:06.183421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-be275ae3-0eb9-4f33-8ba1-f39038262995 req-ef15d202-62c5-4cde-8322-273941e90e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11eb423a-f3d8-4e02-8a41-b64a46503d39", "tag": "10198ebf-6054-49a9-8644-be0c553598ad"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:06.196851 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-be275ae3-0eb9-4f33-8ba1-f39038262995 req-ef15d202-62c5-4cde-8322-273941e90e2d service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:06.197521 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-be275ae3-0eb9-4f33-8ba1-f39038262995 req-ef15d202-62c5-4cde-8322-273941e90e2d service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:06.198026 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-be275ae3-0eb9-4f33-8ba1-f39038262995 req-ef15d202-62c5-4cde-8322-273941e90e2d service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:06.199272 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-81483f6f-924c-478c-afb2-1b66fff151ba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:06.199902 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-81483f6f-924c-478c-afb2-1b66fff151ba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:06.206328 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81483f6f-924c-478c-afb2-1b66fff151ba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:06.207109 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81483f6f-924c-478c-afb2-1b66fff151ba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:06.207727 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81483f6f-924c-478c-afb2-1b66fff151ba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:06.209052 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81483f6f-924c-478c-afb2-1b66fff151ba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:06.209530 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81483f6f-924c-478c-afb2-1b66fff151ba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:06.210096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-81483f6f-924c-478c-afb2-1b66fff151ba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:06.213884 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-be275ae3-0eb9-4f33-8ba1-f39038262995 req-ef15d202-62c5-4cde-8322-273941e90e2d service nova] Creating event network-changed:10198ebf-6054-49a9-8644-be0c553598ad for instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 on hv-cinder-83976 Sep 01 17:46:06.219669 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-be275ae3-0eb9-4f33-8ba1-f39038262995 req-ef15d202-62c5-4cde-8322-273941e90e2d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039493 Sep 01 17:46:06.221204 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 543/1047] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:06.447805 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-81483f6f-924c-478c-afb2-1b66fff151ba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:06.455480 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-81483f6f-924c-478c-afb2-1b66fff151ba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1267 microversion: 2.1 time: 0.261617 Sep 01 17:46:06.456041 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 505/1048] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:06 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:07.477923 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-22e5d59d-c007-4f11-8e8b-6ce1c07e6a8a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:07.478626 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-22e5d59d-c007-4f11-8e8b-6ce1c07e6a8a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:07.485298 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-22e5d59d-c007-4f11-8e8b-6ce1c07e6a8a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:07.485831 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-22e5d59d-c007-4f11-8e8b-6ce1c07e6a8a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:07.486272 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-22e5d59d-c007-4f11-8e8b-6ce1c07e6a8a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:07.486974 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-22e5d59d-c007-4f11-8e8b-6ce1c07e6a8a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:07.487439 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-22e5d59d-c007-4f11-8e8b-6ce1c07e6a8a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:07.487862 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-22e5d59d-c007-4f11-8e8b-6ce1c07e6a8a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:07.624701 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-22e5d59d-c007-4f11-8e8b-6ce1c07e6a8a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:07.632548 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-22e5d59d-c007-4f11-8e8b-6ce1c07e6a8a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1267 microversion: 2.1 time: 0.159464 Sep 01 17:46:07.633110 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 544/1049] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:07 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:08.655380 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-d01ed874-3fe3-4463-8300-5936ccf3eea2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:08.655968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-d01ed874-3fe3-4463-8300-5936ccf3eea2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:08.658401 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:08.664128 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d01ed874-3fe3-4463-8300-5936ccf3eea2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:08.664616 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d01ed874-3fe3-4463-8300-5936ccf3eea2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:08.665053 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d01ed874-3fe3-4463-8300-5936ccf3eea2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:08.665777 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d01ed874-3fe3-4463-8300-5936ccf3eea2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:08.666227 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d01ed874-3fe3-4463-8300-5936ccf3eea2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:08.666919 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-d01ed874-3fe3-4463-8300-5936ccf3eea2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:08.670584 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=85 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:08.800803 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-d01ed874-3fe3-4463-8300-5936ccf3eea2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:08.809357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-d01ed874-3fe3-4463-8300-5936ccf3eea2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1267 microversion: 2.1 time: 0.157781 Sep 01 17:46:08.809955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 506/1050] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:08 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:09.830048 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2f728876-d6a8-4739-9220-fca7f26eba10 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:09.830662 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2f728876-d6a8-4739-9220-fca7f26eba10 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:09.832648 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:09.834149 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:09.839787 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2f728876-d6a8-4739-9220-fca7f26eba10 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:09.840275 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2f728876-d6a8-4739-9220-fca7f26eba10 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:09.840710 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2f728876-d6a8-4739-9220-fca7f26eba10 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:09.841415 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2f728876-d6a8-4739-9220-fca7f26eba10 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:09.841901 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2f728876-d6a8-4739-9220-fca7f26eba10 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:09.842325 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2f728876-d6a8-4739-9220-fca7f26eba10 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:09.845810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:09.985525 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2f728876-d6a8-4739-9220-fca7f26eba10 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:09.994226 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2f728876-d6a8-4739-9220-fca7f26eba10 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1267 microversion: 2.1 time: 0.168049 Sep 01 17:46:09.994792 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 545/1051] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:09 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:11.015438 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-788da8d0-09ec-41e4-8f21-b31ff6ca41aa tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:11.016024 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-788da8d0-09ec-41e4-8f21-b31ff6ca41aa tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:11.022884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-788da8d0-09ec-41e4-8f21-b31ff6ca41aa tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:11.023378 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-788da8d0-09ec-41e4-8f21-b31ff6ca41aa tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:11.023878 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-788da8d0-09ec-41e4-8f21-b31ff6ca41aa tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:11.024659 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-788da8d0-09ec-41e4-8f21-b31ff6ca41aa tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:11.025115 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-788da8d0-09ec-41e4-8f21-b31ff6ca41aa tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:11.025539 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-788da8d0-09ec-41e4-8f21-b31ff6ca41aa tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:11.158018 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-788da8d0-09ec-41e4-8f21-b31ff6ca41aa tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:11.166386 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-788da8d0-09ec-41e4-8f21-b31ff6ca41aa tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1267 microversion: 2.1 time: 0.154937 Sep 01 17:46:11.167215 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 507/1052] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:11 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:12.187352 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-9a7e3834-51e2-4ae9-bd54-06f6aefc9d31 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:12.187962 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-9a7e3834-51e2-4ae9-bd54-06f6aefc9d31 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:12.189832 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=8 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:12.196131 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a7e3834-51e2-4ae9-bd54-06f6aefc9d31 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:12.196623 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a7e3834-51e2-4ae9-bd54-06f6aefc9d31 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:12.197061 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a7e3834-51e2-4ae9-bd54-06f6aefc9d31 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:12.197801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a7e3834-51e2-4ae9-bd54-06f6aefc9d31 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:12.198260 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a7e3834-51e2-4ae9-bd54-06f6aefc9d31 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:12.198684 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9a7e3834-51e2-4ae9-bd54-06f6aefc9d31 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:12.332097 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-9a7e3834-51e2-4ae9-bd54-06f6aefc9d31 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:12.339771 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-9a7e3834-51e2-4ae9-bd54-06f6aefc9d31 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1267 microversion: 2.1 time: 0.156478 Sep 01 17:46:12.340355 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 546/1053] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:12 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:13.360763 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-108a9508-5c0d-4177-9de3-9bcc99568e91 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:13.361322 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-108a9508-5c0d-4177-9de3-9bcc99568e91 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:13.363577 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=6 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:13.369631 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-108a9508-5c0d-4177-9de3-9bcc99568e91 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:13.370122 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-108a9508-5c0d-4177-9de3-9bcc99568e91 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:13.370554 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-108a9508-5c0d-4177-9de3-9bcc99568e91 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:13.371245 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-108a9508-5c0d-4177-9de3-9bcc99568e91 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:13.371694 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-108a9508-5c0d-4177-9de3-9bcc99568e91 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:13.372116 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-108a9508-5c0d-4177-9de3-9bcc99568e91 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:13.505164 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-108a9508-5c0d-4177-9de3-9bcc99568e91 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:13.514196 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-108a9508-5c0d-4177-9de3-9bcc99568e91 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1267 microversion: 2.1 time: 0.157328 Sep 01 17:46:13.514804 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 508/1054] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:13 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:14.534523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-54260683-97ec-4631-8b5d-033eedf27058 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:14.535186 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-54260683-97ec-4631-8b5d-033eedf27058 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:14.542040 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-54260683-97ec-4631-8b5d-033eedf27058 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:14.542519 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-54260683-97ec-4631-8b5d-033eedf27058 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:14.542948 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-54260683-97ec-4631-8b5d-033eedf27058 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:14.543638 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-54260683-97ec-4631-8b5d-033eedf27058 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:14.544092 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-54260683-97ec-4631-8b5d-033eedf27058 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:14.544510 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-54260683-97ec-4631-8b5d-033eedf27058 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:14.680120 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-54260683-97ec-4631-8b5d-033eedf27058 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:14.688251 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-54260683-97ec-4631-8b5d-033eedf27058 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1267 microversion: 2.1 time: 0.157532 Sep 01 17:46:14.688909 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 547/1055] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:14 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:15.709985 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4f0afc15-5553-445f-bedc-fa2b99a2dfac tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:15.710599 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4f0afc15-5553-445f-bedc-fa2b99a2dfac tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:15.717032 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f0afc15-5553-445f-bedc-fa2b99a2dfac tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:15.717516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f0afc15-5553-445f-bedc-fa2b99a2dfac tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:15.717980 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f0afc15-5553-445f-bedc-fa2b99a2dfac tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:15.718670 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f0afc15-5553-445f-bedc-fa2b99a2dfac tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:15.719119 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f0afc15-5553-445f-bedc-fa2b99a2dfac tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:15.719540 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4f0afc15-5553-445f-bedc-fa2b99a2dfac tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:15.857948 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4f0afc15-5553-445f-bedc-fa2b99a2dfac tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:15.865740 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4f0afc15-5553-445f-bedc-fa2b99a2dfac tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1267 microversion: 2.1 time: 0.160142 Sep 01 17:46:15.866304 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 509/1056] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:15 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:16.886200 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-08ac8cb0-2014-4e20-a119-e09798da561d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:16.886831 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-08ac8cb0-2014-4e20-a119-e09798da561d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:16.893145 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08ac8cb0-2014-4e20-a119-e09798da561d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:16.893651 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08ac8cb0-2014-4e20-a119-e09798da561d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:16.894083 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08ac8cb0-2014-4e20-a119-e09798da561d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:16.894772 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08ac8cb0-2014-4e20-a119-e09798da561d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:16.895219 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08ac8cb0-2014-4e20-a119-e09798da561d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:16.895634 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-08ac8cb0-2014-4e20-a119-e09798da561d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:17.025418 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-08ac8cb0-2014-4e20-a119-e09798da561d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:17.033232 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-08ac8cb0-2014-4e20-a119-e09798da561d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1267 microversion: 2.1 time: 0.150890 Sep 01 17:46:17.033855 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 548/1057] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:16 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:17.688696 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-fff84957-7938-4236-9ede-4c59088da81f req-5e589bad-2cb8-4df6-8c1b-25649d4ff6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11eb423a-f3d8-4e02-8a41-b64a46503d39", "name": "network-vif-plugged", "status": "completed", "tag": "10198ebf-6054-49a9-8644-be0c553598ad"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:17.699475 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-fff84957-7938-4236-9ede-4c59088da81f req-5e589bad-2cb8-4df6-8c1b-25649d4ff6fd service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:17.699967 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-fff84957-7938-4236-9ede-4c59088da81f req-5e589bad-2cb8-4df6-8c1b-25649d4ff6fd service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:17.700400 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-fff84957-7938-4236-9ede-4c59088da81f req-5e589bad-2cb8-4df6-8c1b-25649d4ff6fd service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:17.714916 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-fff84957-7938-4236-9ede-4c59088da81f req-5e589bad-2cb8-4df6-8c1b-25649d4ff6fd service nova] Creating event network-vif-plugged:10198ebf-6054-49a9-8644-be0c553598ad for instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 on hv-cinder-83976 Sep 01 17:46:17.719904 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-fff84957-7938-4236-9ede-4c59088da81f req-5e589bad-2cb8-4df6-8c1b-25649d4ff6fd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034988 Sep 01 17:46:17.720509 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 510/1058] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:18.055736 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-c91ade0a-23a7-489d-8e08-87fbc31fee58 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:18.056350 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-c91ade0a-23a7-489d-8e08-87fbc31fee58 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:18.062779 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c91ade0a-23a7-489d-8e08-87fbc31fee58 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:18.063263 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c91ade0a-23a7-489d-8e08-87fbc31fee58 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:18.063700 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c91ade0a-23a7-489d-8e08-87fbc31fee58 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:18.064384 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c91ade0a-23a7-489d-8e08-87fbc31fee58 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:18.064835 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c91ade0a-23a7-489d-8e08-87fbc31fee58 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:18.065249 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-c91ade0a-23a7-489d-8e08-87fbc31fee58 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:18.200960 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-c91ade0a-23a7-489d-8e08-87fbc31fee58 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:18.208771 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-c91ade0a-23a7-489d-8e08-87fbc31fee58 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1267 microversion: 2.1 time: 0.157451 Sep 01 17:46:18.209345 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 549/1059] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:18 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:19.230491 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-1307b9a6-046a-462d-a7a9-89548ec13e87 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:19.231181 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-1307b9a6-046a-462d-a7a9-89548ec13e87 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:19.237203 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1307b9a6-046a-462d-a7a9-89548ec13e87 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:19.237721 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1307b9a6-046a-462d-a7a9-89548ec13e87 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:19.238178 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1307b9a6-046a-462d-a7a9-89548ec13e87 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:19.238876 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1307b9a6-046a-462d-a7a9-89548ec13e87 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:19.239324 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1307b9a6-046a-462d-a7a9-89548ec13e87 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:19.239750 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1307b9a6-046a-462d-a7a9-89548ec13e87 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:19.372127 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-1307b9a6-046a-462d-a7a9-89548ec13e87 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:19.379879 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-1307b9a6-046a-462d-a7a9-89548ec13e87 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1453 microversion: 2.1 time: 0.154221 Sep 01 17:46:19.380499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 511/1060] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:19 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:19.400853 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f6223cbe-bbd2-424a-ae98-4d9e240ab251 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:19.401452 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f6223cbe-bbd2-424a-ae98-4d9e240ab251 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:19.407911 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f6223cbe-bbd2-424a-ae98-4d9e240ab251 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:19.408409 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f6223cbe-bbd2-424a-ae98-4d9e240ab251 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:19.408838 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f6223cbe-bbd2-424a-ae98-4d9e240ab251 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:19.409525 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f6223cbe-bbd2-424a-ae98-4d9e240ab251 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:19.410006 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f6223cbe-bbd2-424a-ae98-4d9e240ab251 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:19.410426 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f6223cbe-bbd2-424a-ae98-4d9e240ab251 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:19.550598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f6223cbe-bbd2-424a-ae98-4d9e240ab251 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:19.559044 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f6223cbe-bbd2-424a-ae98-4d9e240ab251 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1453 microversion: 2.1 time: 0.162116 Sep 01 17:46:19.559620 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 550/1061] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:19 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:21.232658 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-81c33f2c-c75a-4430-a9fb-f2982e4f0699 req-927f22e1-c1e6-4d1f-8f51-1d15b90ba19b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11eb423a-f3d8-4e02-8a41-b64a46503d39", "tag": "10198ebf-6054-49a9-8644-be0c553598ad"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:21.243170 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-81c33f2c-c75a-4430-a9fb-f2982e4f0699 req-927f22e1-c1e6-4d1f-8f51-1d15b90ba19b service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:21.243651 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-81c33f2c-c75a-4430-a9fb-f2982e4f0699 req-927f22e1-c1e6-4d1f-8f51-1d15b90ba19b service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:21.244078 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-81c33f2c-c75a-4430-a9fb-f2982e4f0699 req-927f22e1-c1e6-4d1f-8f51-1d15b90ba19b service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:21.255197 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-81c33f2c-c75a-4430-a9fb-f2982e4f0699 req-927f22e1-c1e6-4d1f-8f51-1d15b90ba19b service nova] Creating event network-changed:10198ebf-6054-49a9-8644-be0c553598ad for instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 on hv-cinder-83976 Sep 01 17:46:21.260522 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-81c33f2c-c75a-4430-a9fb-f2982e4f0699 req-927f22e1-c1e6-4d1f-8f51-1d15b90ba19b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031487 Sep 01 17:46:21.261369 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 512/1062] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:38.031791 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-b4fe11e2-e0ab-4a3a-8527-695bf507de6a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:38.032332 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-b4fe11e2-e0ab-4a3a-8527-695bf507de6a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:38.034677 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=11 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:38.035318 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=35 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:38.041667 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b4fe11e2-e0ab-4a3a-8527-695bf507de6a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:38.042407 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b4fe11e2-e0ab-4a3a-8527-695bf507de6a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:38.043483 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b4fe11e2-e0ab-4a3a-8527-695bf507de6a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:38.043603 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b4fe11e2-e0ab-4a3a-8527-695bf507de6a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:38.043946 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b4fe11e2-e0ab-4a3a-8527-695bf507de6a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:38.044362 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-b4fe11e2-e0ab-4a3a-8527-695bf507de6a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:38.068202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-b4fe11e2-e0ab-4a3a-8527-695bf507de6a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/ips" status: 200 len: 144 microversion: 2.1 time: 0.040030 Sep 01 17:46:38.068778 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 551/1063] 10.222.0.100 () {58 vars in 1253 bytes} [Thu Sep 1 17:46:38 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/ips => generated 144 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:39.394137 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=13 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:39.394869 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=33 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:39.400188 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6280c54d-7704-4109-b9ea-811c932e2c79 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c094e8bf-1bc2-4741-8164-3c838013175c"}} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:39.402822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6280c54d-7704-4109-b9ea-811c932e2c79 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:39.409656 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6280c54d-7704-4109-b9ea-811c932e2c79 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:39.410139 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6280c54d-7704-4109-b9ea-811c932e2c79 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:39.410573 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6280c54d-7704-4109-b9ea-811c932e2c79 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:39.411919 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6280c54d-7704-4109-b9ea-811c932e2c79 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:39.412378 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6280c54d-7704-4109-b9ea-811c932e2c79 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:39.412911 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6280c54d-7704-4109-b9ea-811c932e2c79 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:39.654399 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6280c54d-7704-4109-b9ea-811c932e2c79 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "POST /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261512 Sep 01 17:46:39.655240 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 513/1064] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:46:39 2022] POST /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:46.132194 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5154c024-e38b-4682-9e3c-746610610120 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:46.134376 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5154c024-e38b-4682-9e3c-746610610120 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:46.140419 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5154c024-e38b-4682-9e3c-746610610120 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:46.140894 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5154c024-e38b-4682-9e3c-746610610120 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:46.141320 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5154c024-e38b-4682-9e3c-746610610120 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:46.142030 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5154c024-e38b-4682-9e3c-746610610120 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:46.142477 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5154c024-e38b-4682-9e3c-746610610120 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:46.142893 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5154c024-e38b-4682-9e3c-746610610120 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:46.173141 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5154c024-e38b-4682-9e3c-746610610120 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Sep 01 17:46:46.173624 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 552/1065] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:46:46 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:46:46.184921 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-54071727-4c2b-4496-9ba3-f96aad7b34f1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:46.185485 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-54071727-4c2b-4496-9ba3-f96aad7b34f1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:46.192344 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-54071727-4c2b-4496-9ba3-f96aad7b34f1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:46.193101 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-54071727-4c2b-4496-9ba3-f96aad7b34f1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:46.193555 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-54071727-4c2b-4496-9ba3-f96aad7b34f1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:46.194291 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-54071727-4c2b-4496-9ba3-f96aad7b34f1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:46.194750 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-54071727-4c2b-4496-9ba3-f96aad7b34f1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:46.195183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-54071727-4c2b-4496-9ba3-f96aad7b34f1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:46.225095 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-54071727-4c2b-4496-9ba3-f96aad7b34f1 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments/c094e8bf-1bc2-4741-8164-3c838013175c" status: 200 len: 194 microversion: 2.1 time: 0.044404 Sep 01 17:46:46.225694 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 514/1066] 10.222.0.100 () {58 vars in 1418 bytes} [Thu Sep 1 17:46:46 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments/c094e8bf-1bc2-4741-8164-3c838013175c => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:47.558145 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-9d50c3a1-4fb0-4240-b69c-4362918f5708 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc4c4c5b-2377-419b-8446-367cd61e2e42"}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:47.560456 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-9d50c3a1-4fb0-4240-b69c-4362918f5708 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:47.566968 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9d50c3a1-4fb0-4240-b69c-4362918f5708 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:47.567477 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9d50c3a1-4fb0-4240-b69c-4362918f5708 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:47.567910 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9d50c3a1-4fb0-4240-b69c-4362918f5708 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:47.568603 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9d50c3a1-4fb0-4240-b69c-4362918f5708 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:47.569057 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9d50c3a1-4fb0-4240-b69c-4362918f5708 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:47.569480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-9d50c3a1-4fb0-4240-b69c-4362918f5708 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:47.964517 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-9d50c3a1-4fb0-4240-b69c-4362918f5708 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "POST /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.410001 Sep 01 17:46:47.965056 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 553/1067] 10.222.0.100 () {60 vars in 1328 bytes} [Thu Sep 1 17:46:47 2022] POST /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments => generated 194 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:55.498651 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-895c0a92-e502-495c-aa02-1c726735473b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:55.500920 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-895c0a92-e502-495c-aa02-1c726735473b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:55.508320 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-895c0a92-e502-495c-aa02-1c726735473b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:55.508951 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-895c0a92-e502-495c-aa02-1c726735473b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:55.509444 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-895c0a92-e502-495c-aa02-1c726735473b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:55.510277 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-895c0a92-e502-495c-aa02-1c726735473b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:55.510768 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-895c0a92-e502-495c-aa02-1c726735473b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:55.511198 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-895c0a92-e502-495c-aa02-1c726735473b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:55.543040 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-895c0a92-e502-495c-aa02-1c726735473b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048291 Sep 01 17:46:55.543595 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 515/1068] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:46:55 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:55.691108 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7525db57-2159-46f3-a9f1-8d9eab3113b8 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:55.691686 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7525db57-2159-46f3-a9f1-8d9eab3113b8 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:55.698390 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7525db57-2159-46f3-a9f1-8d9eab3113b8 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:55.699286 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7525db57-2159-46f3-a9f1-8d9eab3113b8 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:55.699286 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7525db57-2159-46f3-a9f1-8d9eab3113b8 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:55.699986 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7525db57-2159-46f3-a9f1-8d9eab3113b8 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:55.700443 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7525db57-2159-46f3-a9f1-8d9eab3113b8 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:55.700871 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7525db57-2159-46f3-a9f1-8d9eab3113b8 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:55.732087 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7525db57-2159-46f3-a9f1-8d9eab3113b8 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments/c094e8bf-1bc2-4741-8164-3c838013175c" status: 200 len: 194 microversion: 2.1 time: 0.046054 Sep 01 17:46:55.732738 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 554/1069] 10.222.0.100 () {58 vars in 1418 bytes} [Thu Sep 1 17:46:55 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments/c094e8bf-1bc2-4741-8164-3c838013175c => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:55.743066 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-85167ad4-29df-465b-bccb-cbaf56018b4b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:55.743592 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-85167ad4-29df-465b-bccb-cbaf56018b4b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:55.749388 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85167ad4-29df-465b-bccb-cbaf56018b4b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:55.749926 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85167ad4-29df-465b-bccb-cbaf56018b4b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:55.750363 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85167ad4-29df-465b-bccb-cbaf56018b4b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:55.751049 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85167ad4-29df-465b-bccb-cbaf56018b4b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:55.751505 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85167ad4-29df-465b-bccb-cbaf56018b4b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:55.751932 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-85167ad4-29df-465b-bccb-cbaf56018b4b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:55.889175 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-85167ad4-29df-465b-bccb-cbaf56018b4b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lazy-loading 'services' on Instance uuid 27ca8574-a9e1-4b07-819f-e8199ba59322 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:46:55.962149 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-85167ad4-29df-465b-bccb-cbaf56018b4b tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "DELETE /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments/c094e8bf-1bc2-4741-8164-3c838013175c" status: 202 len: 0 microversion: 2.1 time: 0.223050 Sep 01 17:46:55.962727 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 516/1070] 10.222.0.100 () {58 vars in 1421 bytes} [Thu Sep 1 17:46:55 2022] DELETE /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments/c094e8bf-1bc2-4741-8164-3c838013175c => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:46:57.079824 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ea6f459f-2510-41d9-95f0-06d69e631aac tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:57.080360 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ea6f459f-2510-41d9-95f0-06d69e631aac tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:57.087332 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ea6f459f-2510-41d9-95f0-06d69e631aac tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:57.087809 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ea6f459f-2510-41d9-95f0-06d69e631aac tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:57.088239 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ea6f459f-2510-41d9-95f0-06d69e631aac tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:57.088928 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ea6f459f-2510-41d9-95f0-06d69e631aac tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:57.089381 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ea6f459f-2510-41d9-95f0-06d69e631aac tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:57.089833 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ea6f459f-2510-41d9-95f0-06d69e631aac tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:57.117955 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ea6f459f-2510-41d9-95f0-06d69e631aac tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments/cc4c4c5b-2377-419b-8446-367cd61e2e42" status: 200 len: 194 microversion: 2.1 time: 0.041988 Sep 01 17:46:57.118535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 555/1071] 10.222.0.100 () {58 vars in 1418 bytes} [Thu Sep 1 17:46:57 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments/cc4c4c5b-2377-419b-8446-367cd61e2e42 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:57.132701 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a0ae24dd-f69b-4a35-829c-8636eab794ad tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:57.133418 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a0ae24dd-f69b-4a35-829c-8636eab794ad tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:57.139615 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a0ae24dd-f69b-4a35-829c-8636eab794ad tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:57.140101 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a0ae24dd-f69b-4a35-829c-8636eab794ad tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:57.140546 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a0ae24dd-f69b-4a35-829c-8636eab794ad tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:57.141234 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a0ae24dd-f69b-4a35-829c-8636eab794ad tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:57.141714 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a0ae24dd-f69b-4a35-829c-8636eab794ad tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:57.142143 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a0ae24dd-f69b-4a35-829c-8636eab794ad tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:57.226987 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-a0ae24dd-f69b-4a35-829c-8636eab794ad tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lazy-loading 'services' on Instance uuid 27ca8574-a9e1-4b07-819f-e8199ba59322 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:46:57.299376 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a0ae24dd-f69b-4a35-829c-8636eab794ad tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "DELETE /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments/cc4c4c5b-2377-419b-8446-367cd61e2e42" status: 202 len: 0 microversion: 2.1 time: 0.173934 Sep 01 17:46:57.299969 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 517/1072] 10.222.0.100 () {58 vars in 1421 bytes} [Thu Sep 1 17:46:57 2022] DELETE /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments/cc4c4c5b-2377-419b-8446-367cd61e2e42 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:46:58.466188 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-5e888c0f-749e-4a77-aa57-65aa71d7be5d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:58.468445 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-5e888c0f-749e-4a77-aa57-65aa71d7be5d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:58.474869 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e888c0f-749e-4a77-aa57-65aa71d7be5d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:58.475352 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e888c0f-749e-4a77-aa57-65aa71d7be5d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:58.475788 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e888c0f-749e-4a77-aa57-65aa71d7be5d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:58.476479 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e888c0f-749e-4a77-aa57-65aa71d7be5d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:58.476988 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e888c0f-749e-4a77-aa57-65aa71d7be5d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:58.477369 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-5e888c0f-749e-4a77-aa57-65aa71d7be5d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:58.507527 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-5e888c0f-749e-4a77-aa57-65aa71d7be5d tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045279 Sep 01 17:46:58.508224 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 556/1073] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:46:58 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:46:58.622969 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6eea8498-cecf-4888-a85c-43b63c89b14a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:58.625381 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6eea8498-cecf-4888-a85c-43b63c89b14a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:58.632702 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6eea8498-cecf-4888-a85c-43b63c89b14a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:58.633195 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6eea8498-cecf-4888-a85c-43b63c89b14a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:58.633660 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6eea8498-cecf-4888-a85c-43b63c89b14a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:58.634360 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6eea8498-cecf-4888-a85c-43b63c89b14a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:58.634822 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6eea8498-cecf-4888-a85c-43b63c89b14a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:58.635251 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6eea8498-cecf-4888-a85c-43b63c89b14a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:58.666079 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6eea8498-cecf-4888-a85c-43b63c89b14a tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047580 Sep 01 17:46:58.666645 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 518/1074] 10.222.0.100 () {58 vars in 1307 bytes} [Thu Sep 1 17:46:58 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:46:58.728041 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-4594563f-2dd1-4a4e-856f-5461052da5ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:58.728529 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4594563f-2dd1-4a4e-856f-5461052da5ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:58.734387 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4594563f-2dd1-4a4e-856f-5461052da5ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:58.734860 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4594563f-2dd1-4a4e-856f-5461052da5ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:58.735282 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4594563f-2dd1-4a4e-856f-5461052da5ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:58.735964 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4594563f-2dd1-4a4e-856f-5461052da5ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:58.736407 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4594563f-2dd1-4a4e-856f-5461052da5ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:58.736824 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-4594563f-2dd1-4a4e-856f-5461052da5ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:58.762978 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-4594563f-2dd1-4a4e-856f-5461052da5ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Going to try to terminate instance {{(pid=127233) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:46:58.843282 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-4594563f-2dd1-4a4e-856f-5461052da5ce tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "DELETE /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 204 len: 0 microversion: 2.1 time: 0.119287 Sep 01 17:46:58.843984 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 557/1075] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:46:58 2022] DELETE /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:46:58.853541 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-8d8eaef3-2e32-4fe8-be1c-51b92fd5e646 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:58.854189 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-8d8eaef3-2e32-4fe8-be1c-51b92fd5e646 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:58.860085 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8d8eaef3-2e32-4fe8-be1c-51b92fd5e646 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:58.860573 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8d8eaef3-2e32-4fe8-be1c-51b92fd5e646 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:58.861013 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8d8eaef3-2e32-4fe8-be1c-51b92fd5e646 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:58.861735 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8d8eaef3-2e32-4fe8-be1c-51b92fd5e646 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:58.862198 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8d8eaef3-2e32-4fe8-be1c-51b92fd5e646 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:58.862628 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-8d8eaef3-2e32-4fe8-be1c-51b92fd5e646 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:58.999740 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-8d8eaef3-2e32-4fe8-be1c-51b92fd5e646 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:59.007745 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-8d8eaef3-2e32-4fe8-be1c-51b92fd5e646 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1675 microversion: 2.1 time: 0.158345 Sep 01 17:46:59.008313 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 519/1076] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:58 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:00.029783 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1091f0d2-ee8b-41b6-a441-8334a5150c18 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:00.030401 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-1091f0d2-ee8b-41b6-a441-8334a5150c18 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:00.037709 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1091f0d2-ee8b-41b6-a441-8334a5150c18 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:00.038198 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1091f0d2-ee8b-41b6-a441-8334a5150c18 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:00.038629 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1091f0d2-ee8b-41b6-a441-8334a5150c18 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:00.039320 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1091f0d2-ee8b-41b6-a441-8334a5150c18 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:00.039769 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1091f0d2-ee8b-41b6-a441-8334a5150c18 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:00.040185 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1091f0d2-ee8b-41b6-a441-8334a5150c18 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:00.171382 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-1091f0d2-ee8b-41b6-a441-8334a5150c18 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:00.179789 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1091f0d2-ee8b-41b6-a441-8334a5150c18 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1675 microversion: 2.1 time: 0.154321 Sep 01 17:47:00.180353 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 558/1077] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:00 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:01.202552 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-851f92f2-5631-4ad4-a7b7-fe82f87142c4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:01.203200 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-851f92f2-5631-4ad4-a7b7-fe82f87142c4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:01.209862 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-851f92f2-5631-4ad4-a7b7-fe82f87142c4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:01.210357 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-851f92f2-5631-4ad4-a7b7-fe82f87142c4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:01.210799 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-851f92f2-5631-4ad4-a7b7-fe82f87142c4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:01.211516 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-851f92f2-5631-4ad4-a7b7-fe82f87142c4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:01.211977 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-851f92f2-5631-4ad4-a7b7-fe82f87142c4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:01.212407 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-851f92f2-5631-4ad4-a7b7-fe82f87142c4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:01.406230 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-851f92f2-5631-4ad4-a7b7-fe82f87142c4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8259269a28a401eb4ddbe90f128fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdeb9d9f0eb4f1c805502bb30a99ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:01.415047 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-851f92f2-5631-4ad4-a7b7-fe82f87142c4 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 200 len: 1675 microversion: 2.1 time: 0.216320 Sep 01 17:47:01.415592 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 520/1078] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:01 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 1675 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:01.862467 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-d2fd7b12-1392-40af-8a38-ef099cc7ac50 req-d46b3fff-1dfa-4a0e-8330-4ec156f98101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ca8574-a9e1-4b07-819f-e8199ba59322", "name": "network-vif-deleted", "tag": "33eaf352-5499-4fb6-9dda-e9292ec8b809"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:47:01.873205 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-d2fd7b12-1392-40af-8a38-ef099cc7ac50 req-d46b3fff-1dfa-4a0e-8330-4ec156f98101 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:01.873988 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-d2fd7b12-1392-40af-8a38-ef099cc7ac50 req-d46b3fff-1dfa-4a0e-8330-4ec156f98101 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:01.874592 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-d2fd7b12-1392-40af-8a38-ef099cc7ac50 req-d46b3fff-1dfa-4a0e-8330-4ec156f98101 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:01.887972 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-d2fd7b12-1392-40af-8a38-ef099cc7ac50 req-d46b3fff-1dfa-4a0e-8330-4ec156f98101 service nova] Creating event network-vif-deleted:33eaf352-5499-4fb6-9dda-e9292ec8b809 for instance 27ca8574-a9e1-4b07-819f-e8199ba59322 on hv-cinder-83976 Sep 01 17:47:01.895280 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-d2fd7b12-1392-40af-8a38-ef099cc7ac50 req-d46b3fff-1dfa-4a0e-8330-4ec156f98101 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098871 Sep 01 17:47:01.896897 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 559/1079] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:47:02.438191 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-276868ff-9c02-4460-b142-e2a02c663c76 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:02.439470 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-276868ff-9c02-4460-b142-e2a02c663c76 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:02.447085 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-276868ff-9c02-4460-b142-e2a02c663c76 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:02.447600 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-276868ff-9c02-4460-b142-e2a02c663c76 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:02.448151 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-276868ff-9c02-4460-b142-e2a02c663c76 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:02.449406 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-276868ff-9c02-4460-b142-e2a02c663c76 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:02.450073 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-276868ff-9c02-4460-b142-e2a02c663c76 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:02.450508 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-276868ff-9c02-4460-b142-e2a02c663c76 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:02.467460 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-276868ff-9c02-4460-b142-e2a02c663c76 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] HTTP exception thrown: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-276868ff-9c02-4460-b142-e2a02c663c76 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Request method failure captured: Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 HTTP/1.1 Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO8Kg8DO_3jKdfaMS8P29gwjXrsYt-5Fceowvj__gfDyuBRB3gC4MUUyE64icIHkc_37P9NTn29NY7uMZZnW0zXubVc4ChoXMGBlS0IGtn_FsfsZw1eLys7qwUW5Yw0_6fh6Xq0DNupgfT8tSeLxAKlFcLWF1cPREKylIl4DiPpDtH0 Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 8cdeb9d9f0eb4f1c805502bb30a99ebc Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:47:02.469183 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:47:02.471096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:47:02.471096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:02.471096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 8cdeb9d9f0eb4f1c805502bb30a99ebc Sep 01 17:47:02.471096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:02.471096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-AttachVolumeTestJSON-274265072-project Sep 01 17:47:02.471096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:47:02.471096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:47:02.471096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: d8259269a28a401eb4ddbe90f128fe71 Sep 01 17:47:02.471096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-AttachVolumeTestJSON-274265072-project Sep 01 17:47:02.471096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:47:02.471096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:02.471096 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '27ca8574-a9e1-4b07-819f-e8199ba59322'} Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:47:02.471959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:02.473543 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:02.474893 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-276868ff-9c02-4460-b142-e2a02c663c76 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Returning 404 to user: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:47:02.474893 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-276868ff-9c02-4460-b142-e2a02c663c76 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 404 len: 111 microversion: 2.1 time: 0.038070 Sep 01 17:47:02.474893 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 521/1080] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:02 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:47:02.480659 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-33ee5426-c6bf-416c-ab49-245650d7cdec tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '.version_select at 0x7f354a73d8b0>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:02.500676 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-33ee5426-c6bf-416c-ab49-245650d7cdec tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-639296043" status: 202 len: 0 microversion: 2.1 time: 0.023898 Sep 01 17:47:02.501464 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 560/1081] 10.222.0.100 () {58 vars in 1223 bytes} [Thu Sep 1 17:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-639296043 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:47:05.428812 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-feadc59b-d7be-4a0c-a63b-c3f1aa2a2db6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:05.429308 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-feadc59b-d7be-4a0c-a63b-c3f1aa2a2db6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:05.435725 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-feadc59b-d7be-4a0c-a63b-c3f1aa2a2db6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:05.436204 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-feadc59b-d7be-4a0c-a63b-c3f1aa2a2db6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:05.436640 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-feadc59b-d7be-4a0c-a63b-c3f1aa2a2db6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:05.437331 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-feadc59b-d7be-4a0c-a63b-c3f1aa2a2db6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:05.437820 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-feadc59b-d7be-4a0c-a63b-c3f1aa2a2db6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:05.438250 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-feadc59b-d7be-4a0c-a63b-c3f1aa2a2db6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:05.452304 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-feadc59b-d7be-4a0c-a63b-c3f1aa2a2db6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] HTTP exception thrown: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-feadc59b-d7be-4a0c-a63b-c3f1aa2a2db6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Request method failure captured: Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: DELETE /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 HTTP/1.1 Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO8Kg8DO_3jKdfaMS8P29gwjXrsYt-5Fceowvj__gfDyuBRB3gC4MUUyE64icIHkc_37P9NTn29NY7uMZZnW0zXubVc4ChoXMGBlS0IGtn_FsfsZw1eLys7qwUW5Yw0_6fh6Xq0DNupgfT8tSeLxAKlFcLWF1cPREKylIl4DiPpDtH0 Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 8cdeb9d9f0eb4f1c805502bb30a99ebc Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:47:05.453935 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:47:05.455506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:47:05.455506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:05.455506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 8cdeb9d9f0eb4f1c805502bb30a99ebc Sep 01 17:47:05.455506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:05.455506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-AttachVolumeTestJSON-274265072-project Sep 01 17:47:05.455506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:47:05.455506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:47:05.455506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: d8259269a28a401eb4ddbe90f128fe71 Sep 01 17:47:05.455506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-AttachVolumeTestJSON-274265072-project Sep 01 17:47:05.455506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:47:05.455506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:05.455506 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '27ca8574-a9e1-4b07-819f-e8199ba59322'} Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:47:05.456347 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:05.457633 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:05.459583 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-feadc59b-d7be-4a0c-a63b-c3f1aa2a2db6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Returning 404 to user: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:47:05.459583 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-feadc59b-d7be-4a0c-a63b-c3f1aa2a2db6 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "DELETE /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 404 len: 111 microversion: 2.1 time: 0.030574 Sep 01 17:47:05.459583 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 522/1082] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:47:05 2022] DELETE /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:47:05.464869 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-acefd9d4-2f0b-4b84-a8f5-a44f6be81249 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:05.465626 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-acefd9d4-2f0b-4b84-a8f5-a44f6be81249 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: 27ca8574-a9e1-4b07-819f-e8199ba59322] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:05.472206 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-acefd9d4-2f0b-4b84-a8f5-a44f6be81249 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:05.472689 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-acefd9d4-2f0b-4b84-a8f5-a44f6be81249 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:05.473124 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-acefd9d4-2f0b-4b84-a8f5-a44f6be81249 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:05.473838 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-acefd9d4-2f0b-4b84-a8f5-a44f6be81249 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:05.474302 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-acefd9d4-2f0b-4b84-a8f5-a44f6be81249 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:05.474815 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-acefd9d4-2f0b-4b84-a8f5-a44f6be81249 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:05.487757 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-acefd9d4-2f0b-4b84-a8f5-a44f6be81249 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] HTTP exception thrown: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-acefd9d4-2f0b-4b84-a8f5-a44f6be81249 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Request method failure captured: Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 HTTP/1.1 Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO8Kg8DO_3jKdfaMS8P29gwjXrsYt-5Fceowvj__gfDyuBRB3gC4MUUyE64icIHkc_37P9NTn29NY7uMZZnW0zXubVc4ChoXMGBlS0IGtn_FsfsZw1eLys7qwUW5Yw0_6fh6Xq0DNupgfT8tSeLxAKlFcLWF1cPREKylIl4DiPpDtH0 Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 8cdeb9d9f0eb4f1c805502bb30a99ebc Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:47:05.489399 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:47:05.491900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:47:05.491900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:05.491900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 8cdeb9d9f0eb4f1c805502bb30a99ebc Sep 01 17:47:05.491900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:05.491900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-AttachVolumeTestJSON-274265072-project Sep 01 17:47:05.491900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:47:05.491900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:47:05.491900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: d8259269a28a401eb4ddbe90f128fe71 Sep 01 17:47:05.491900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-AttachVolumeTestJSON-274265072-project Sep 01 17:47:05.491900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:47:05.491900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:05.491900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '27ca8574-a9e1-4b07-819f-e8199ba59322'} Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:47:05.492807 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. Sep 01 17:47:05.494690 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:47:05.496307 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-acefd9d4-2f0b-4b84-a8f5-a44f6be81249 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Returning 404 to user: Instance 27ca8574-a9e1-4b07-819f-e8199ba59322 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:47:05.496307 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-acefd9d4-2f0b-4b84-a8f5-a44f6be81249 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322" status: 404 len: 111 microversion: 2.1 time: 0.030866 Sep 01 17:47:05.496307 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 561/1083] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:05 2022] GET /compute/v2.1/servers/27ca8574-a9e1-4b07-819f-e8199ba59322 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 17:47:06.643427 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-716b92e6-144c-41d8-b9bd-9e0ecfa90193 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:06.643921 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-716b92e6-144c-41d8-b9bd-9e0ecfa90193 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:06.650574 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-716b92e6-144c-41d8-b9bd-9e0ecfa90193 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:06.651057 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-716b92e6-144c-41d8-b9bd-9e0ecfa90193 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:06.651497 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-716b92e6-144c-41d8-b9bd-9e0ecfa90193 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:06.652193 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-716b92e6-144c-41d8-b9bd-9e0ecfa90193 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:06.652648 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-716b92e6-144c-41d8-b9bd-9e0ecfa90193 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:06.653080 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-716b92e6-144c-41d8-b9bd-9e0ecfa90193 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:06.667753 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-716b92e6-144c-41d8-b9bd-9e0ecfa90193 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] HTTP exception thrown: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-716b92e6-144c-41d8-b9bd-9e0ecfa90193 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Request method failure captured: Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: DELETE /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 HTTP/1.1 Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO8Kg8DO_3jKdfaMS8P29gwjXrsYt-5Fceowvj__gfDyuBRB3gC4MUUyE64icIHkc_37P9NTn29NY7uMZZnW0zXubVc4ChoXMGBlS0IGtn_FsfsZw1eLys7qwUW5Yw0_6fh6Xq0DNupgfT8tSeLxAKlFcLWF1cPREKylIl4DiPpDtH0 Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 8cdeb9d9f0eb4f1c805502bb30a99ebc Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:47:06.669302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:47:06.670884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:47:06.670884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:06.670884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 8cdeb9d9f0eb4f1c805502bb30a99ebc Sep 01 17:47:06.670884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:06.670884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-AttachVolumeTestJSON-274265072-project Sep 01 17:47:06.670884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:47:06.670884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:47:06.670884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: d8259269a28a401eb4ddbe90f128fe71 Sep 01 17:47:06.670884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-AttachVolumeTestJSON-274265072-project Sep 01 17:47:06.670884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:47:06.670884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:47:06.670884 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': 'bad71e4c-acb3-4e98-a9a4-5cd212974512'} Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:47:06.671830 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:47:06.673134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:47:06.674500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-716b92e6-144c-41d8-b9bd-9e0ecfa90193 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Returning 404 to user: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:47:06.674500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-716b92e6-144c-41d8-b9bd-9e0ecfa90193 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "DELETE /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 404 len: 111 microversion: 2.1 time: 0.031171 Sep 01 17:47:06.674500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 523/1084] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:47:06 2022] DELETE /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:47:06.680227 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ef5a1b05-2eab-4d7e-ae95-a23fbca00284 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:06.680834 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ef5a1b05-2eab-4d7e-ae95-a23fbca00284 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] [instance: bad71e4c-acb3-4e98-a9a4-5cd212974512] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:06.687382 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ef5a1b05-2eab-4d7e-ae95-a23fbca00284 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:06.687857 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ef5a1b05-2eab-4d7e-ae95-a23fbca00284 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:06.688292 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ef5a1b05-2eab-4d7e-ae95-a23fbca00284 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:06.688967 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ef5a1b05-2eab-4d7e-ae95-a23fbca00284 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:06.689413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ef5a1b05-2eab-4d7e-ae95-a23fbca00284 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:06.689984 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ef5a1b05-2eab-4d7e-ae95-a23fbca00284 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:06.706115 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-ef5a1b05-2eab-4d7e-ae95-a23fbca00284 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] HTTP exception thrown: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ef5a1b05-2eab-4d7e-ae95-a23fbca00284 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Request method failure captured: Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 HTTP/1.1 Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO8Kg8DO_3jKdfaMS8P29gwjXrsYt-5Fceowvj__gfDyuBRB3gC4MUUyE64icIHkc_37P9NTn29NY7uMZZnW0zXubVc4ChoXMGBlS0IGtn_FsfsZw1eLys7qwUW5Yw0_6fh6Xq0DNupgfT8tSeLxAKlFcLWF1cPREKylIl4DiPpDtH0 Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 8cdeb9d9f0eb4f1c805502bb30a99ebc Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:47:06.707637 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:47:06.709535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8cdeb9d9f0eb4f1c805502bb30a99ebc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:47:06.709535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:06.709535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 8cdeb9d9f0eb4f1c805502bb30a99ebc Sep 01 17:47:06.709535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-AttachVolumeTestJSON-274265072 Sep 01 17:47:06.709535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-AttachVolumeTestJSON-274265072-project Sep 01 17:47:06.709535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:47:06.709535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:47:06.709535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: d8259269a28a401eb4ddbe90f128fe71 Sep 01 17:47:06.709535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-AttachVolumeTestJSON-274265072-project Sep 01 17:47:06.709535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:47:06.709535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:47:06.709535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': 'bad71e4c-acb3-4e98-a9a4-5cd212974512'} Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:47:06.710658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. Sep 01 17:47:06.712109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:47:06.713629 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ef5a1b05-2eab-4d7e-ae95-a23fbca00284 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] Returning 404 to user: Instance bad71e4c-acb3-4e98-a9a4-5cd212974512 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:47:06.713629 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ef5a1b05-2eab-4d7e-ae95-a23fbca00284 tempest-AttachVolumeTestJSON-274265072 tempest-AttachVolumeTestJSON-274265072-project] 10.222.0.100 "GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512" status: 404 len: 111 microversion: 2.1 time: 0.033710 Sep 01 17:47:06.713629 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 562/1085] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:06 2022] GET /compute/v2.1/servers/bad71e4c-acb3-4e98-a9a4-5cd212974512 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:48:19.608686 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=22 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:19.609364 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:19.610826 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 17:48:19.610954 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Thu Sep 1 17:48:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 (ip 10.222.0.100) !!! Sep 01 17:48:19.615890 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-1d709144-4a50-46d8-9f66-63fe63b670bf tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:19.616386 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-1d709144-4a50-46d8-9f66-63fe63b670bf tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:19.625984 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1d709144-4a50-46d8-9f66-63fe63b670bf tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:19.626461 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1d709144-4a50-46d8-9f66-63fe63b670bf tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:19.626892 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1d709144-4a50-46d8-9f66-63fe63b670bf tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:19.627577 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1d709144-4a50-46d8-9f66-63fe63b670bf tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:19.628033 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1d709144-4a50-46d8-9f66-63fe63b670bf tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:19.628474 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-1d709144-4a50-46d8-9f66-63fe63b670bf tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:19.656275 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-1d709144-4a50-46d8-9f66-63fe63b670bf tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Going to try to terminate instance {{(pid=127232) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:48:19.731160 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-1d709144-4a50-46d8-9f66-63fe63b670bf tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "DELETE /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 204 len: 0 microversion: 2.1 time: 0.124134 Sep 01 17:48:19.731751 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 524/1086] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:48:19 2022] DELETE /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:48:19.738315 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:19.739129 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:19.745254 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-521128c3-e11c-494d-bd41-a0e8f7051ddc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:19.745975 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-521128c3-e11c-494d-bd41-a0e8f7051ddc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:19.754368 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-521128c3-e11c-494d-bd41-a0e8f7051ddc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:19.754750 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-521128c3-e11c-494d-bd41-a0e8f7051ddc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:19.755388 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-521128c3-e11c-494d-bd41-a0e8f7051ddc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:19.756725 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-521128c3-e11c-494d-bd41-a0e8f7051ddc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:19.757609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-521128c3-e11c-494d-bd41-a0e8f7051ddc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:19.758039 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-521128c3-e11c-494d-bd41-a0e8f7051ddc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:19.892440 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-521128c3-e11c-494d-bd41-a0e8f7051ddc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:19.900961 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-521128c3-e11c-494d-bd41-a0e8f7051ddc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1577 microversion: 2.1 time: 0.164704 Sep 01 17:48:19.901535 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 563/1087] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:19 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:20.923134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-4331ca8a-c7ba-485e-8c96-8aa0839007b5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:20.923837 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-4331ca8a-c7ba-485e-8c96-8aa0839007b5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:20.930469 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4331ca8a-c7ba-485e-8c96-8aa0839007b5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:20.930952 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4331ca8a-c7ba-485e-8c96-8aa0839007b5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:20.931390 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4331ca8a-c7ba-485e-8c96-8aa0839007b5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:20.932083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4331ca8a-c7ba-485e-8c96-8aa0839007b5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:20.932536 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4331ca8a-c7ba-485e-8c96-8aa0839007b5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:20.932959 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-4331ca8a-c7ba-485e-8c96-8aa0839007b5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:21.072656 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-4331ca8a-c7ba-485e-8c96-8aa0839007b5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:21.080355 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-4331ca8a-c7ba-485e-8c96-8aa0839007b5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1577 microversion: 2.1 time: 0.161469 Sep 01 17:48:21.080931 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 525/1088] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:20 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:22.102292 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-35643209-d856-4db7-bcb1-ed581c23d195 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:22.102820 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-35643209-d856-4db7-bcb1-ed581c23d195 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:22.109276 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35643209-d856-4db7-bcb1-ed581c23d195 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:22.109794 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35643209-d856-4db7-bcb1-ed581c23d195 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:22.110231 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35643209-d856-4db7-bcb1-ed581c23d195 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:22.110928 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35643209-d856-4db7-bcb1-ed581c23d195 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:22.111378 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35643209-d856-4db7-bcb1-ed581c23d195 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:22.111800 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-35643209-d856-4db7-bcb1-ed581c23d195 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:22.245749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-35643209-d856-4db7-bcb1-ed581c23d195 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:22.253893 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-35643209-d856-4db7-bcb1-ed581c23d195 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1577 microversion: 2.1 time: 0.155682 Sep 01 17:48:22.254477 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 564/1089] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:22 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:48:23.276466 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cc0399a6-9a26-48e0-9441-6a8a0f4b674a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:23.277040 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-cc0399a6-9a26-48e0-9441-6a8a0f4b674a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:23.283443 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cc0399a6-9a26-48e0-9441-6a8a0f4b674a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:23.283928 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cc0399a6-9a26-48e0-9441-6a8a0f4b674a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:23.284364 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cc0399a6-9a26-48e0-9441-6a8a0f4b674a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:23.285204 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cc0399a6-9a26-48e0-9441-6a8a0f4b674a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:23.285688 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cc0399a6-9a26-48e0-9441-6a8a0f4b674a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:23.286772 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cc0399a6-9a26-48e0-9441-6a8a0f4b674a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:23.416737 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-cc0399a6-9a26-48e0-9441-6a8a0f4b674a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:23.424635 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-cc0399a6-9a26-48e0-9441-6a8a0f4b674a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1577 microversion: 2.1 time: 0.152347 Sep 01 17:48:23.425190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 526/1090] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:23 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:24.447170 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-15e1d1b7-0c4c-4c33-b0c2-28ffcdce274a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:24.448373 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-15e1d1b7-0c4c-4c33-b0c2-28ffcdce274a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:24.455274 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15e1d1b7-0c4c-4c33-b0c2-28ffcdce274a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:24.455751 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15e1d1b7-0c4c-4c33-b0c2-28ffcdce274a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:24.456378 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15e1d1b7-0c4c-4c33-b0c2-28ffcdce274a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:24.457087 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15e1d1b7-0c4c-4c33-b0c2-28ffcdce274a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:24.457536 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15e1d1b7-0c4c-4c33-b0c2-28ffcdce274a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:24.457978 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-15e1d1b7-0c4c-4c33-b0c2-28ffcdce274a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:24.648027 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-15e1d1b7-0c4c-4c33-b0c2-28ffcdce274a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:24.659933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-15e1d1b7-0c4c-4c33-b0c2-28ffcdce274a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1577 microversion: 2.1 time: 0.216489 Sep 01 17:48:24.661491 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 565/1091] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:24 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1577 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:25.029777 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-aa5308e2-40c3-45b9-a242-446e09c969eb req-b8244339-1ccc-407d-b689-dca32b342019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11eb423a-f3d8-4e02-8a41-b64a46503d39", "name": "network-vif-deleted", "tag": "10198ebf-6054-49a9-8644-be0c553598ad"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:48:25.044920 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-aa5308e2-40c3-45b9-a242-446e09c969eb req-b8244339-1ccc-407d-b689-dca32b342019 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:25.045502 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-aa5308e2-40c3-45b9-a242-446e09c969eb req-b8244339-1ccc-407d-b689-dca32b342019 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:25.045878 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-aa5308e2-40c3-45b9-a242-446e09c969eb req-b8244339-1ccc-407d-b689-dca32b342019 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:25.061436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-aa5308e2-40c3-45b9-a242-446e09c969eb req-b8244339-1ccc-407d-b689-dca32b342019 service nova] Creating event network-vif-deleted:10198ebf-6054-49a9-8644-be0c553598ad for instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 on hv-cinder-83976 Sep 01 17:48:25.068940 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-aa5308e2-40c3-45b9-a242-446e09c969eb req-b8244339-1ccc-407d-b689-dca32b342019 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042887 Sep 01 17:48:25.070227 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 527/1092] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:48:25.684421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:25.684976 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:25.691376 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:25.691852 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:25.692278 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:25.693697 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:25.694156 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:25.694581 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:25.729343 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:25.730109 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:25.730680 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:25.731159 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.objects.instance [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lazy-loading 'fault' on Instance uuid 11eb423a-f3d8-4e02-8a41-b64a46503d39 {{(pid=127233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:48:25.781121 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:25.793257 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-2aa1244e-887a-4406-b69b-6dca3e00c1f0 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 200 len: 1232 microversion: 2.1 time: 0.112491 Sep 01 17:48:25.793999 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 566/1093] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:25 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 1232 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:26.816089 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-99cb1d40-e02a-4544-a476-1fe32bb75074 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:26.816722 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-99cb1d40-e02a-4544-a476-1fe32bb75074 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:26.823678 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-99cb1d40-e02a-4544-a476-1fe32bb75074 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:26.824158 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-99cb1d40-e02a-4544-a476-1fe32bb75074 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:26.824619 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-99cb1d40-e02a-4544-a476-1fe32bb75074 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:26.825302 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-99cb1d40-e02a-4544-a476-1fe32bb75074 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:26.825779 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-99cb1d40-e02a-4544-a476-1fe32bb75074 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:26.826201 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-99cb1d40-e02a-4544-a476-1fe32bb75074 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:26.840126 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-99cb1d40-e02a-4544-a476-1fe32bb75074 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] HTTP exception thrown: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-99cb1d40-e02a-4544-a476-1fe32bb75074 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Request method failure captured: Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 HTTP/1.1 Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO--5IZbmxlIGk_1Azkz4kBWOoW6N0v4hKvvS_Nl9jy8dhcMAqxoh3IYAtKyJAk_UEonBhHQy9GiP4KfgNjYclJcMVS6NnoDAXbHfmYvbMWSxwk7aCkk8gM51L0VaYa3rrph2FJ2XvjcPqxNsbeTZ1Gzqi2JiQ9PNnufQ8OUcXWtnqQ Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 2e0189e8a6ef4f2c930f0864100a9d82 Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:48:26.841842 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:48:26.843638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:48:26.843638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:48:26.843638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 2e0189e8a6ef4f2c930f0864100a9d82 Sep 01 17:48:26.843638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:48:26.843638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-TestVolumeBootPattern-1562634802-project Sep 01 17:48:26.843638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:48:26.843638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:48:26.843638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: cf0dc05b996e4aa3a1d7605028c64f30 Sep 01 17:48:26.843638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-TestVolumeBootPattern-1562634802-project Sep 01 17:48:26.843638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:48:26.843638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:48:26.843638 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '11eb423a-f3d8-4e02-8a41-b64a46503d39'} Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:48:26.844964 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:48:26.847010 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:48:26.848500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-99cb1d40-e02a-4544-a476-1fe32bb75074 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Returning 404 to user: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:48:26.848500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-99cb1d40-e02a-4544-a476-1fe32bb75074 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 404 len: 111 microversion: 2.1 time: 0.032221 Sep 01 17:48:26.848500 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 528/1094] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:26 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 17:48:26.944959 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-461912599", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-398492581", "security_groups": [{"name": "tempest-secgroup-smoke-629838131"}], "block_device_mapping_v2": [{"uuid": "f78b50e9-a3c9-4041-9733-e79875dfa24d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "35671c59-ec30-4d34-bd86-c3e22ee22f08"}]}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:48:27.058512 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.network.neutron [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] validate_networks() for [('35671c59-ec30-4d34-bd86-c3e22ee22f08', None, None, None, None, None)] {{(pid=127233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:48:27.550385 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Flavor limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:48:27.550810 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Image limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:48:27.551295 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Flavor pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:48:27.551711 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Image pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:48:27.552145 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:48:27.561767 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:27.562255 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:27.562688 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:27.563413 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:27.563864 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:27.564284 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:27.581477 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Getting quotas for project 2e0189e8a6ef4f2c930f0864100a9d82. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:48:27.585725 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Getting quotas for user cf0dc05b996e4aa3a1d7605028c64f30 and project 2e0189e8a6ef4f2c930f0864100a9d82. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:48:27.641912 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Going to run 1 instances... {{(pid=127233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:48:27.644145 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f78b50e9-a3c9-4041-9733-e79875dfa24d',volume_size=None,volume_type=None)] {{(pid=127233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:48:27.781557 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-7bef7e9c-3152-4a2c-8e38-aff8b6a913d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.840477 Sep 01 17:48:27.782237 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 567/1095] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:48:26 2022] POST /compute/v2.1/servers => generated 407 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:48:27.797882 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-3ca7c1b0-2f55-4195-a369-b23a8452ece1 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:27.798938 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-3ca7c1b0-2f55-4195-a369-b23a8452ece1 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:27.875671 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-3ca7c1b0-2f55-4195-a369-b23a8452ece1 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:27.883029 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-3ca7c1b0-2f55-4195-a369-b23a8452ece1 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1096 microversion: 2.1 time: 0.092899 Sep 01 17:48:27.883608 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 529/1096] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:27 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1096 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:28.905658 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f45beb70-fbdb-4b5e-9415-7a8dc0689c4b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:28.906271 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f45beb70-fbdb-4b5e-9415-7a8dc0689c4b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:28.913795 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f45beb70-fbdb-4b5e-9415-7a8dc0689c4b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:28.914457 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f45beb70-fbdb-4b5e-9415-7a8dc0689c4b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:28.914893 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f45beb70-fbdb-4b5e-9415-7a8dc0689c4b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:28.915590 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f45beb70-fbdb-4b5e-9415-7a8dc0689c4b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:28.919195 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f45beb70-fbdb-4b5e-9415-7a8dc0689c4b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:28.919746 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f45beb70-fbdb-4b5e-9415-7a8dc0689c4b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:28.990448 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f45beb70-fbdb-4b5e-9415-7a8dc0689c4b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:28.998512 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f45beb70-fbdb-4b5e-9415-7a8dc0689c4b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1194 microversion: 2.1 time: 0.097549 Sep 01 17:48:28.999289 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 568/1097] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:28 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:30.021476 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-44089c32-df3c-4d8d-97d3-8c8dd14d6539 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:30.022371 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-44089c32-df3c-4d8d-97d3-8c8dd14d6539 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:30.032466 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-44089c32-df3c-4d8d-97d3-8c8dd14d6539 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:30.032966 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-44089c32-df3c-4d8d-97d3-8c8dd14d6539 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:30.033410 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-44089c32-df3c-4d8d-97d3-8c8dd14d6539 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:30.034148 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-44089c32-df3c-4d8d-97d3-8c8dd14d6539 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:30.034607 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-44089c32-df3c-4d8d-97d3-8c8dd14d6539 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:30.035210 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-44089c32-df3c-4d8d-97d3-8c8dd14d6539 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:30.266191 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-44089c32-df3c-4d8d-97d3-8c8dd14d6539 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:30.274219 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-44089c32-df3c-4d8d-97d3-8c8dd14d6539 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1267 microversion: 2.1 time: 0.257504 Sep 01 17:48:30.274809 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 530/1098] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:30 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:48:30.595981 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-e9ab2a6f-f8c2-4000-9fa7-141b2cc032bd req-d3782235-b279-4852-8f60-21547700e5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1831462e-5b04-4398-a345-adddf1000d01", "tag": "97c1e60d-a1c0-4dfe-af88-ec6826948aa1"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:48:30.607712 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-e9ab2a6f-f8c2-4000-9fa7-141b2cc032bd req-d3782235-b279-4852-8f60-21547700e5e6 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:30.608192 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-e9ab2a6f-f8c2-4000-9fa7-141b2cc032bd req-d3782235-b279-4852-8f60-21547700e5e6 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:30.608621 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-e9ab2a6f-f8c2-4000-9fa7-141b2cc032bd req-d3782235-b279-4852-8f60-21547700e5e6 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:30.620436 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-e9ab2a6f-f8c2-4000-9fa7-141b2cc032bd req-d3782235-b279-4852-8f60-21547700e5e6 service nova] Creating event network-changed:97c1e60d-a1c0-4dfe-af88-ec6826948aa1 for instance 1831462e-5b04-4398-a345-adddf1000d01 on hv-cinder-83976 Sep 01 17:48:30.625855 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-e9ab2a6f-f8c2-4000-9fa7-141b2cc032bd req-d3782235-b279-4852-8f60-21547700e5e6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035203 Sep 01 17:48:30.626780 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 569/1099] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:48:31.296609 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-b4073e8d-e54c-474c-835c-97483b3373f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:31.297377 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-b4073e8d-e54c-474c-835c-97483b3373f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:31.304982 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b4073e8d-e54c-474c-835c-97483b3373f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:31.305562 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b4073e8d-e54c-474c-835c-97483b3373f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:31.306525 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b4073e8d-e54c-474c-835c-97483b3373f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:31.306872 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b4073e8d-e54c-474c-835c-97483b3373f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:31.307403 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b4073e8d-e54c-474c-835c-97483b3373f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:31.307906 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-b4073e8d-e54c-474c-835c-97483b3373f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:31.543048 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-b4073e8d-e54c-474c-835c-97483b3373f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:31.551486 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-b4073e8d-e54c-474c-835c-97483b3373f4 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1267 microversion: 2.1 time: 0.259456 Sep 01 17:48:31.552202 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 531/1100] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:31 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:32.573733 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-84da6a6e-a8a3-4b5a-9835-211c70e3d563 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:32.574437 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-84da6a6e-a8a3-4b5a-9835-211c70e3d563 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:32.580931 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-84da6a6e-a8a3-4b5a-9835-211c70e3d563 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:32.581425 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-84da6a6e-a8a3-4b5a-9835-211c70e3d563 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:32.581894 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-84da6a6e-a8a3-4b5a-9835-211c70e3d563 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:32.582598 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-84da6a6e-a8a3-4b5a-9835-211c70e3d563 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:32.583076 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-84da6a6e-a8a3-4b5a-9835-211c70e3d563 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:32.584106 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-84da6a6e-a8a3-4b5a-9835-211c70e3d563 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:32.728175 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-84da6a6e-a8a3-4b5a-9835-211c70e3d563 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:32.736147 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-84da6a6e-a8a3-4b5a-9835-211c70e3d563 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1267 microversion: 2.1 time: 0.167390 Sep 01 17:48:32.736729 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 570/1101] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:32 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:33.758047 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-6ff9bbf6-abe0-4979-ba79-21c860b18f59 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:33.758665 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-6ff9bbf6-abe0-4979-ba79-21c860b18f59 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:33.765315 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ff9bbf6-abe0-4979-ba79-21c860b18f59 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:33.765907 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ff9bbf6-abe0-4979-ba79-21c860b18f59 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:33.766385 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ff9bbf6-abe0-4979-ba79-21c860b18f59 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:33.767161 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ff9bbf6-abe0-4979-ba79-21c860b18f59 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:33.767751 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ff9bbf6-abe0-4979-ba79-21c860b18f59 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:33.768204 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-6ff9bbf6-abe0-4979-ba79-21c860b18f59 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:34.161207 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-6ff9bbf6-abe0-4979-ba79-21c860b18f59 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:34.169709 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-6ff9bbf6-abe0-4979-ba79-21c860b18f59 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1267 microversion: 2.1 time: 0.415760 Sep 01 17:48:34.170273 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 532/1102] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:33 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1267 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:35.190594 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-62d6c7fa-4894-41b3-93af-764e54f95cbd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:35.191243 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-62d6c7fa-4894-41b3-93af-764e54f95cbd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:35.198778 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-62d6c7fa-4894-41b3-93af-764e54f95cbd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:35.199471 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-62d6c7fa-4894-41b3-93af-764e54f95cbd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:35.200082 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-62d6c7fa-4894-41b3-93af-764e54f95cbd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:35.200993 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-62d6c7fa-4894-41b3-93af-764e54f95cbd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:35.201920 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-62d6c7fa-4894-41b3-93af-764e54f95cbd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:35.202480 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-62d6c7fa-4894-41b3-93af-764e54f95cbd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:35.340324 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-62d6c7fa-4894-41b3-93af-764e54f95cbd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:35.348057 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-62d6c7fa-4894-41b3-93af-764e54f95cbd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1267 microversion: 2.1 time: 0.161468 Sep 01 17:48:35.348614 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 571/1103] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:35 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:36.369902 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f4f9ab26-acfa-4a55-ace1-344af355d582 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:36.370501 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f4f9ab26-acfa-4a55-ace1-344af355d582 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:36.376930 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f4f9ab26-acfa-4a55-ace1-344af355d582 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:36.377416 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f4f9ab26-acfa-4a55-ace1-344af355d582 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:36.377873 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f4f9ab26-acfa-4a55-ace1-344af355d582 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:36.378559 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f4f9ab26-acfa-4a55-ace1-344af355d582 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:36.379005 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f4f9ab26-acfa-4a55-ace1-344af355d582 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:36.379425 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f4f9ab26-acfa-4a55-ace1-344af355d582 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:36.524520 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f4f9ab26-acfa-4a55-ace1-344af355d582 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:36.532662 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f4f9ab26-acfa-4a55-ace1-344af355d582 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1267 microversion: 2.1 time: 0.167250 Sep 01 17:48:36.533346 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 533/1104] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:36 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:48:37.554177 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-dadb99a6-a2aa-4639-8d89-d2bcb1501c21 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:37.554900 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-dadb99a6-a2aa-4639-8d89-d2bcb1501c21 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:37.561423 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dadb99a6-a2aa-4639-8d89-d2bcb1501c21 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:37.561934 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dadb99a6-a2aa-4639-8d89-d2bcb1501c21 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:37.562371 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dadb99a6-a2aa-4639-8d89-d2bcb1501c21 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:37.563081 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dadb99a6-a2aa-4639-8d89-d2bcb1501c21 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:37.563516 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dadb99a6-a2aa-4639-8d89-d2bcb1501c21 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:37.563941 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-dadb99a6-a2aa-4639-8d89-d2bcb1501c21 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:37.579865 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:37.596601 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=6 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:37.718346 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-dadb99a6-a2aa-4639-8d89-d2bcb1501c21 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:37.726802 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-dadb99a6-a2aa-4639-8d89-d2bcb1501c21 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1267 microversion: 2.1 time: 0.175830 Sep 01 17:48:37.727373 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 572/1105] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:37 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:38.750714 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5ec6cbe5-bd6d-49e7-9132-04fc87a96f51 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:38.751386 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5ec6cbe5-bd6d-49e7-9132-04fc87a96f51 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:38.753849 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:38.759621 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5ec6cbe5-bd6d-49e7-9132-04fc87a96f51 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:38.760108 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5ec6cbe5-bd6d-49e7-9132-04fc87a96f51 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:38.760548 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5ec6cbe5-bd6d-49e7-9132-04fc87a96f51 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:38.761314 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5ec6cbe5-bd6d-49e7-9132-04fc87a96f51 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:38.761768 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5ec6cbe5-bd6d-49e7-9132-04fc87a96f51 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:38.762193 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5ec6cbe5-bd6d-49e7-9132-04fc87a96f51 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:38.906236 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5ec6cbe5-bd6d-49e7-9132-04fc87a96f51 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:38.913911 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5ec6cbe5-bd6d-49e7-9132-04fc87a96f51 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1267 microversion: 2.1 time: 0.167134 Sep 01 17:48:38.914487 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 534/1106] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:38 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:39.934885 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-56b51a52-1c72-4246-a07c-abf7f72d3e42 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:39.935515 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-56b51a52-1c72-4246-a07c-abf7f72d3e42 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:39.941979 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-56b51a52-1c72-4246-a07c-abf7f72d3e42 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:39.942479 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-56b51a52-1c72-4246-a07c-abf7f72d3e42 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:39.942918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-56b51a52-1c72-4246-a07c-abf7f72d3e42 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:39.943612 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-56b51a52-1c72-4246-a07c-abf7f72d3e42 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:39.944196 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-56b51a52-1c72-4246-a07c-abf7f72d3e42 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:39.944660 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-56b51a52-1c72-4246-a07c-abf7f72d3e42 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:40.084010 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-56b51a52-1c72-4246-a07c-abf7f72d3e42 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:40.092383 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-56b51a52-1c72-4246-a07c-abf7f72d3e42 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1267 microversion: 2.1 time: 0.161398 Sep 01 17:48:40.092958 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 573/1107] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:39 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:40.557382 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-a067dfbc-ea09-426a-b815-4a4b47a9bcf8 req-779dc4d6-2693-45a2-8383-bb8e15f512b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1831462e-5b04-4398-a345-adddf1000d01", "name": "network-vif-plugged", "status": "completed", "tag": "97c1e60d-a1c0-4dfe-af88-ec6826948aa1"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:48:40.566896 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-a067dfbc-ea09-426a-b815-4a4b47a9bcf8 req-779dc4d6-2693-45a2-8383-bb8e15f512b7 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:40.567373 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-a067dfbc-ea09-426a-b815-4a4b47a9bcf8 req-779dc4d6-2693-45a2-8383-bb8e15f512b7 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:40.567807 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-a067dfbc-ea09-426a-b815-4a4b47a9bcf8 req-779dc4d6-2693-45a2-8383-bb8e15f512b7 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:40.579239 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-a067dfbc-ea09-426a-b815-4a4b47a9bcf8 req-779dc4d6-2693-45a2-8383-bb8e15f512b7 service nova] Creating event network-vif-plugged:97c1e60d-a1c0-4dfe-af88-ec6826948aa1 for instance 1831462e-5b04-4398-a345-adddf1000d01 on hv-cinder-83976 Sep 01 17:48:40.584227 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-a067dfbc-ea09-426a-b815-4a4b47a9bcf8 req-779dc4d6-2693-45a2-8383-bb8e15f512b7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152355 Sep 01 17:48:40.585134 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 535/1108] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:48:41.113812 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-288c77de-ceb8-4290-bf11-d22aca3dd0bc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:41.114370 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-288c77de-ceb8-4290-bf11-d22aca3dd0bc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:41.121623 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-288c77de-ceb8-4290-bf11-d22aca3dd0bc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:41.122111 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-288c77de-ceb8-4290-bf11-d22aca3dd0bc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:41.122542 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-288c77de-ceb8-4290-bf11-d22aca3dd0bc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:41.123231 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-288c77de-ceb8-4290-bf11-d22aca3dd0bc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:41.123686 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-288c77de-ceb8-4290-bf11-d22aca3dd0bc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:41.124102 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-288c77de-ceb8-4290-bf11-d22aca3dd0bc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:41.256038 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-288c77de-ceb8-4290-bf11-d22aca3dd0bc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:41.263833 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-288c77de-ceb8-4290-bf11-d22aca3dd0bc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1267 microversion: 2.1 time: 0.154001 Sep 01 17:48:41.264404 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 574/1109] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:41 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:42.285441 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cf2bb57a-4c46-488e-915b-6d4364fa215b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:42.286081 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-cf2bb57a-4c46-488e-915b-6d4364fa215b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:42.292292 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cf2bb57a-4c46-488e-915b-6d4364fa215b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:42.293143 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cf2bb57a-4c46-488e-915b-6d4364fa215b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:42.293564 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cf2bb57a-4c46-488e-915b-6d4364fa215b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:42.294203 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cf2bb57a-4c46-488e-915b-6d4364fa215b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:42.294656 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cf2bb57a-4c46-488e-915b-6d4364fa215b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:42.295095 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cf2bb57a-4c46-488e-915b-6d4364fa215b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:42.430776 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-cf2bb57a-4c46-488e-915b-6d4364fa215b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:42.438530 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-cf2bb57a-4c46-488e-915b-6d4364fa215b tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1454 microversion: 2.1 time: 0.157881 Sep 01 17:48:42.439093 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 536/1110] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:42 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:42.458756 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-1a8170da-cb64-4084-a400-7b3c9cf94892 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:42.459360 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-1a8170da-cb64-4084-a400-7b3c9cf94892 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:42.465551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1a8170da-cb64-4084-a400-7b3c9cf94892 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:42.466039 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1a8170da-cb64-4084-a400-7b3c9cf94892 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:42.466471 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1a8170da-cb64-4084-a400-7b3c9cf94892 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:42.467157 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1a8170da-cb64-4084-a400-7b3c9cf94892 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:42.467608 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1a8170da-cb64-4084-a400-7b3c9cf94892 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:42.468026 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-1a8170da-cb64-4084-a400-7b3c9cf94892 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:42.605486 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-1a8170da-cb64-4084-a400-7b3c9cf94892 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:42.613242 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-1a8170da-cb64-4084-a400-7b3c9cf94892 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1454 microversion: 2.1 time: 0.158282 Sep 01 17:48:42.613829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 575/1111] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:42 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:44.247606 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [req-ba654cb5-0699-45e8-8a0f-6514d23ed4d8 req-68f0e4e8-a802-4ab4-986b-fac0e1186063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1831462e-5b04-4398-a345-adddf1000d01", "tag": "97c1e60d-a1c0-4dfe-af88-ec6826948aa1"}]} {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:48:44.258371 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-ba654cb5-0699-45e8-8a0f-6514d23ed4d8 req-68f0e4e8-a802-4ab4-986b-fac0e1186063 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:44.259156 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-ba654cb5-0699-45e8-8a0f-6514d23ed4d8 req-68f0e4e8-a802-4ab4-986b-fac0e1186063 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:44.259594 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [req-ba654cb5-0699-45e8-8a0f-6514d23ed4d8 req-68f0e4e8-a802-4ab4-986b-fac0e1186063 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:44.270578 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.compute.server_external_events [req-ba654cb5-0699-45e8-8a0f-6514d23ed4d8 req-68f0e4e8-a802-4ab4-986b-fac0e1186063 service nova] Creating event network-changed:97c1e60d-a1c0-4dfe-af88-ec6826948aa1 for instance 1831462e-5b04-4398-a345-adddf1000d01 on hv-cinder-83976 Sep 01 17:48:44.276538 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [req-ba654cb5-0699-45e8-8a0f-6514d23ed4d8 req-68f0e4e8-a802-4ab4-986b-fac0e1186063 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032660 Sep 01 17:48:44.277320 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 537/1112] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:50:28.298184 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:28.298916 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=72 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:28.300374 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 17:50:28.300554 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Thu Sep 1 17:50:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.100) !!! Sep 01 17:50:28.313018 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1271352390", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-398492581", "security_groups": [{"name": "tempest-secgroup-smoke-629838131"}], "block_device_mapping_v2": [{"uuid": "ffa8443a-30e0-44e5-bc2e-1e448161f895", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "35671c59-ec30-4d34-bd86-c3e22ee22f08"}]}} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:28.429838 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.network.neutron [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] validate_networks() for [('35671c59-ec30-4d34-bd86-c3e22ee22f08', None, None, None, None, None)] {{(pid=127233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:50:28.815838 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Flavor limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:50:28.816340 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Image limits 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:50:28.816875 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Flavor pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:50:28.817298 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Image pref 0:0:0 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:50:28.817843 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.virt.hardware [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:50:28.827222 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:28.827829 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:28.828269 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:28.829130 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:28.829610 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:28.830041 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:28.848198 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Getting quotas for project 2e0189e8a6ef4f2c930f0864100a9d82. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:50:28.853382 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.quota [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Getting quotas for user cf0dc05b996e4aa3a1d7605028c64f30 and project 2e0189e8a6ef4f2c930f0864100a9d82. Resources: {'ram', 'instances', 'cores'} {{(pid=127233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:50:28.921933 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Going to run 1 instances... {{(pid=127233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:50:28.924063 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ffa8443a-30e0-44e5-bc2e-1e448161f895',volume_size=None,volume_type=None)] {{(pid=127233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:50:29.069433 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-6f5cfbe9-037d-46ee-8fe4-cc0b1ca42244 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.773037 Sep 01 17:50:29.070421 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 576/1113] 10.222.0.100 () {60 vars in 1152 bytes} [Thu Sep 1 17:50:28 2022] POST /compute/v2.1/servers => generated 407 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:50:29.080204 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2ca6f4fb-ce20-4525-b2a5-5193ea59ca9a] AMQP server on 10.222.0.100:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 01 17:50:29.081441 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:29.082290 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:29.083041 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 17:50:29.083227 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Thu Sep 1 17:50:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 (ip 10.222.0.100) !!! Sep 01 17:50:29.091160 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-0a5c2b07-451e-4684-accc-66c8b9b6462f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:29.092362 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-0a5c2b07-451e-4684-accc-66c8b9b6462f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:29.153026 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-0a5c2b07-451e-4684-accc-66c8b9b6462f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:29.160023 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-0a5c2b07-451e-4684-accc-66c8b9b6462f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1097 microversion: 2.1 time: 0.082092 Sep 01 17:50:29.160590 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 538/1114] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:29 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1097 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:30.183648 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-f171cdf8-1805-4439-9477-8af1f7448f07 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:30.184699 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-f171cdf8-1805-4439-9477-8af1f7448f07 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:30.197811 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f171cdf8-1805-4439-9477-8af1f7448f07 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:30.198702 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f171cdf8-1805-4439-9477-8af1f7448f07 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:30.199523 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f171cdf8-1805-4439-9477-8af1f7448f07 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:30.200786 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f171cdf8-1805-4439-9477-8af1f7448f07 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:30.201694 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f171cdf8-1805-4439-9477-8af1f7448f07 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:30.202524 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-f171cdf8-1805-4439-9477-8af1f7448f07 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:30.565207 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-f171cdf8-1805-4439-9477-8af1f7448f07 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:30.574806 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-f171cdf8-1805-4439-9477-8af1f7448f07 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1203 microversion: 2.1 time: 0.396361 Sep 01 17:50:30.575582 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 577/1115] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:30 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1203 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:31.599885 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e9c44138-5f65-45b0-b71a-cc9177a02b68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:31.599885 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e9c44138-5f65-45b0-b71a-cc9177a02b68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:31.610861 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO oslo.messaging._drivers.impl_rabbit [-] [2ca6f4fb-ce20-4525-b2a5-5193ea59ca9a] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 48216. Sep 01 17:50:31.616846 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e9c44138-5f65-45b0-b71a-cc9177a02b68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:31.617258 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e9c44138-5f65-45b0-b71a-cc9177a02b68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:31.618370 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e9c44138-5f65-45b0-b71a-cc9177a02b68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:31.619083 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e9c44138-5f65-45b0-b71a-cc9177a02b68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:31.619547 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e9c44138-5f65-45b0-b71a-cc9177a02b68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:31.620032 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e9c44138-5f65-45b0-b71a-cc9177a02b68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:31.830309 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e9c44138-5f65-45b0-b71a-cc9177a02b68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:31.843875 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e9c44138-5f65-45b0-b71a-cc9177a02b68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1268 microversion: 2.1 time: 0.248201 Sep 01 17:50:31.844745 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 539/1116] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:31 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1268 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:32.109971 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-fb09231f-0879-4133-9992-90d3c3aaf40a req-7f75a6a8-2567-4cfb-b38b-62fe51b72b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5687478d-c2aa-475a-a030-313f2f9ce8e8", "tag": "a4af03c4-ba4c-4cc5-8c49-983fb0570cd4"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:32.122237 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-fb09231f-0879-4133-9992-90d3c3aaf40a req-7f75a6a8-2567-4cfb-b38b-62fe51b72b8f service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:32.122726 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-fb09231f-0879-4133-9992-90d3c3aaf40a req-7f75a6a8-2567-4cfb-b38b-62fe51b72b8f service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:32.123174 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-fb09231f-0879-4133-9992-90d3c3aaf40a req-7f75a6a8-2567-4cfb-b38b-62fe51b72b8f service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:32.136026 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-fb09231f-0879-4133-9992-90d3c3aaf40a req-7f75a6a8-2567-4cfb-b38b-62fe51b72b8f service nova] Creating event network-changed:a4af03c4-ba4c-4cc5-8c49-983fb0570cd4 for instance 5687478d-c2aa-475a-a030-313f2f9ce8e8 on hv-cinder-83976 Sep 01 17:50:32.141494 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-fb09231f-0879-4133-9992-90d3c3aaf40a req-7f75a6a8-2567-4cfb-b38b-62fe51b72b8f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035088 Sep 01 17:50:32.142579 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 578/1117] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:50:32.867077 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-02710b5f-7b27-4853-97cf-75a8a86b8f5c tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:32.867733 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-02710b5f-7b27-4853-97cf-75a8a86b8f5c tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:32.874348 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-02710b5f-7b27-4853-97cf-75a8a86b8f5c tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:32.874824 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-02710b5f-7b27-4853-97cf-75a8a86b8f5c tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:32.875283 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-02710b5f-7b27-4853-97cf-75a8a86b8f5c tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:32.875968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-02710b5f-7b27-4853-97cf-75a8a86b8f5c tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:32.876515 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-02710b5f-7b27-4853-97cf-75a8a86b8f5c tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:32.876929 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-02710b5f-7b27-4853-97cf-75a8a86b8f5c tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:33.096329 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-02710b5f-7b27-4853-97cf-75a8a86b8f5c tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:33.105050 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-02710b5f-7b27-4853-97cf-75a8a86b8f5c tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1268 microversion: 2.1 time: 0.241954 Sep 01 17:50:33.105639 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 540/1118] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:32 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1268 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:34.127911 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-8555c1bf-49b6-48b3-bbc8-349d3ea80ca5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:34.128520 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-8555c1bf-49b6-48b3-bbc8-349d3ea80ca5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:34.136111 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8555c1bf-49b6-48b3-bbc8-349d3ea80ca5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:34.136602 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8555c1bf-49b6-48b3-bbc8-349d3ea80ca5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:34.137044 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8555c1bf-49b6-48b3-bbc8-349d3ea80ca5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:34.137801 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8555c1bf-49b6-48b3-bbc8-349d3ea80ca5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:34.138261 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8555c1bf-49b6-48b3-bbc8-349d3ea80ca5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:34.138687 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-8555c1bf-49b6-48b3-bbc8-349d3ea80ca5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:34.288694 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-8555c1bf-49b6-48b3-bbc8-349d3ea80ca5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:34.297814 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-8555c1bf-49b6-48b3-bbc8-349d3ea80ca5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1268 microversion: 2.1 time: 0.174465 Sep 01 17:50:34.298400 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 579/1119] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:34 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:35.318713 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-e379e7a1-704f-490f-8c69-3efe458fc3d5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:35.319307 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-e379e7a1-704f-490f-8c69-3efe458fc3d5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:35.326549 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e379e7a1-704f-490f-8c69-3efe458fc3d5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:35.327029 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e379e7a1-704f-490f-8c69-3efe458fc3d5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:35.327459 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e379e7a1-704f-490f-8c69-3efe458fc3d5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:35.328144 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e379e7a1-704f-490f-8c69-3efe458fc3d5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:35.328590 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e379e7a1-704f-490f-8c69-3efe458fc3d5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:35.329009 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-e379e7a1-704f-490f-8c69-3efe458fc3d5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:35.467613 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-e379e7a1-704f-490f-8c69-3efe458fc3d5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:35.475271 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-e379e7a1-704f-490f-8c69-3efe458fc3d5 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1268 microversion: 2.1 time: 0.160443 Sep 01 17:50:35.475837 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 541/1120] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:35 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:36.496139 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ad3bada7-fb62-4e79-a0cf-c4c5024e0836 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:36.496833 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ad3bada7-fb62-4e79-a0cf-c4c5024e0836 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:36.503977 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3bada7-fb62-4e79-a0cf-c4c5024e0836 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:36.504627 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3bada7-fb62-4e79-a0cf-c4c5024e0836 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:36.505078 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3bada7-fb62-4e79-a0cf-c4c5024e0836 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:36.507467 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3bada7-fb62-4e79-a0cf-c4c5024e0836 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:36.507467 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3bada7-fb62-4e79-a0cf-c4c5024e0836 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:36.507467 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ad3bada7-fb62-4e79-a0cf-c4c5024e0836 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:36.672647 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ad3bada7-fb62-4e79-a0cf-c4c5024e0836 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:36.682200 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ad3bada7-fb62-4e79-a0cf-c4c5024e0836 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1268 microversion: 2.1 time: 0.190050 Sep 01 17:50:36.683110 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 580/1121] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:36 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:37.703554 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-244f6eb3-2474-4db2-87e7-3c1ba4ec242d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:37.704204 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-244f6eb3-2474-4db2-87e7-3c1ba4ec242d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:37.712439 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-244f6eb3-2474-4db2-87e7-3c1ba4ec242d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:37.713005 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-244f6eb3-2474-4db2-87e7-3c1ba4ec242d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:37.713447 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-244f6eb3-2474-4db2-87e7-3c1ba4ec242d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:37.714193 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-244f6eb3-2474-4db2-87e7-3c1ba4ec242d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:37.714652 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-244f6eb3-2474-4db2-87e7-3c1ba4ec242d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:37.715084 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-244f6eb3-2474-4db2-87e7-3c1ba4ec242d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:37.867015 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-244f6eb3-2474-4db2-87e7-3c1ba4ec242d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:37.879133 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-244f6eb3-2474-4db2-87e7-3c1ba4ec242d tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1268 microversion: 2.1 time: 0.179209 Sep 01 17:50:37.879972 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 542/1122] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:37 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:38.907166 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-ed242380-fe86-4889-8c6d-d1496a0b4335 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:38.907778 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-ed242380-fe86-4889-8c6d-d1496a0b4335 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:38.910315 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=2 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:38.911020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell0:SELECT=6 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:38.918283 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ed242380-fe86-4889-8c6d-d1496a0b4335 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:38.919020 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ed242380-fe86-4889-8c6d-d1496a0b4335 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:38.919458 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ed242380-fe86-4889-8c6d-d1496a0b4335 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:38.920156 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ed242380-fe86-4889-8c6d-d1496a0b4335 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:38.920604 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ed242380-fe86-4889-8c6d-d1496a0b4335 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:38.921024 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-ed242380-fe86-4889-8c6d-d1496a0b4335 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:39.072111 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-ed242380-fe86-4889-8c6d-d1496a0b4335 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:39.080128 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-ed242380-fe86-4889-8c6d-d1496a0b4335 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1268 microversion: 2.1 time: 0.177072 Sep 01 17:50:39.080720 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 581/1123] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:38 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:40.103565 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell0:SELECT=2 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:40.231079 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5a934ba6-a9ab-4d79-9c4f-6e3322b7ec4e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:40.231700 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5a934ba6-a9ab-4d79-9c4f-6e3322b7ec4e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:40.237955 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5a934ba6-a9ab-4d79-9c4f-6e3322b7ec4e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:40.238437 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5a934ba6-a9ab-4d79-9c4f-6e3322b7ec4e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:40.238874 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5a934ba6-a9ab-4d79-9c4f-6e3322b7ec4e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:40.239677 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5a934ba6-a9ab-4d79-9c4f-6e3322b7ec4e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:40.240131 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5a934ba6-a9ab-4d79-9c4f-6e3322b7ec4e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:40.240550 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5a934ba6-a9ab-4d79-9c4f-6e3322b7ec4e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:40.386750 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-5a934ba6-a9ab-4d79-9c4f-6e3322b7ec4e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:40.395001 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5a934ba6-a9ab-4d79-9c4f-6e3322b7ec4e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1268 microversion: 2.1 time: 0.296605 Sep 01 17:50:40.395665 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 543/1124] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:40 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1268 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:41.416982 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-750db4ed-ca9d-4e06-9bcc-2244e356bdcc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:41.417776 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-750db4ed-ca9d-4e06-9bcc-2244e356bdcc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:41.424792 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-750db4ed-ca9d-4e06-9bcc-2244e356bdcc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:41.425280 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-750db4ed-ca9d-4e06-9bcc-2244e356bdcc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:41.425750 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-750db4ed-ca9d-4e06-9bcc-2244e356bdcc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:41.426459 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-750db4ed-ca9d-4e06-9bcc-2244e356bdcc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:41.426904 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-750db4ed-ca9d-4e06-9bcc-2244e356bdcc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:41.427326 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-750db4ed-ca9d-4e06-9bcc-2244e356bdcc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:41.572962 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-750db4ed-ca9d-4e06-9bcc-2244e356bdcc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:41.580833 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-750db4ed-ca9d-4e06-9bcc-2244e356bdcc tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1268 microversion: 2.1 time: 0.168431 Sep 01 17:50:41.581411 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 582/1125] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:41 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:42.602660 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-fde97210-9be2-4530-af5a-af89818971a2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:42.603238 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-fde97210-9be2-4530-af5a-af89818971a2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:42.610265 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fde97210-9be2-4530-af5a-af89818971a2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:42.610761 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fde97210-9be2-4530-af5a-af89818971a2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:42.611206 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fde97210-9be2-4530-af5a-af89818971a2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:42.611921 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fde97210-9be2-4530-af5a-af89818971a2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:42.612384 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fde97210-9be2-4530-af5a-af89818971a2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:42.612819 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-fde97210-9be2-4530-af5a-af89818971a2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:42.775532 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-fde97210-9be2-4530-af5a-af89818971a2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:42.784090 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-fde97210-9be2-4530-af5a-af89818971a2 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1268 microversion: 2.1 time: 0.185582 Sep 01 17:50:42.784673 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 544/1126] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:42 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:43.005970 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-3d848302-6cff-481c-9787-c8cf9546a8e0 req-9fc7b00e-b97d-4a43-925e-a499af16e429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5687478d-c2aa-475a-a030-313f2f9ce8e8", "name": "network-vif-plugged", "status": "completed", "tag": "a4af03c4-ba4c-4cc5-8c49-983fb0570cd4"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:43.018894 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-3d848302-6cff-481c-9787-c8cf9546a8e0 req-9fc7b00e-b97d-4a43-925e-a499af16e429 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:43.019380 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-3d848302-6cff-481c-9787-c8cf9546a8e0 req-9fc7b00e-b97d-4a43-925e-a499af16e429 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:43.019817 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-3d848302-6cff-481c-9787-c8cf9546a8e0 req-9fc7b00e-b97d-4a43-925e-a499af16e429 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:43.035297 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-3d848302-6cff-481c-9787-c8cf9546a8e0 req-9fc7b00e-b97d-4a43-925e-a499af16e429 service nova] Creating event network-vif-plugged:a4af03c4-ba4c-4cc5-8c49-983fb0570cd4 for instance 5687478d-c2aa-475a-a030-313f2f9ce8e8 on hv-cinder-83976 Sep 01 17:50:43.041312 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-3d848302-6cff-481c-9787-c8cf9546a8e0 req-9fc7b00e-b97d-4a43-925e-a499af16e429 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039402 Sep 01 17:50:43.042334 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 583/1127] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:50:43.806637 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-bcb97ed0-7663-4d41-a758-5253aa826d57 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:43.807330 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-bcb97ed0-7663-4d41-a758-5253aa826d57 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:43.814237 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bcb97ed0-7663-4d41-a758-5253aa826d57 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:43.814747 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bcb97ed0-7663-4d41-a758-5253aa826d57 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:43.815190 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bcb97ed0-7663-4d41-a758-5253aa826d57 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:43.815920 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bcb97ed0-7663-4d41-a758-5253aa826d57 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:43.816378 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bcb97ed0-7663-4d41-a758-5253aa826d57 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:43.816895 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-bcb97ed0-7663-4d41-a758-5253aa826d57 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:43.966259 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-bcb97ed0-7663-4d41-a758-5253aa826d57 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:43.974684 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-bcb97ed0-7663-4d41-a758-5253aa826d57 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1268 microversion: 2.1 time: 0.172690 Sep 01 17:50:43.975422 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 545/1128] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:43 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:44.998721 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-a2875b82-4bc5-43a9-83c1-0ae12bc8c9d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:44.999470 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-a2875b82-4bc5-43a9-83c1-0ae12bc8c9d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:45.005921 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2875b82-4bc5-43a9-83c1-0ae12bc8c9d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:45.006412 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2875b82-4bc5-43a9-83c1-0ae12bc8c9d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:45.006849 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2875b82-4bc5-43a9-83c1-0ae12bc8c9d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:45.007557 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2875b82-4bc5-43a9-83c1-0ae12bc8c9d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:45.008121 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2875b82-4bc5-43a9-83c1-0ae12bc8c9d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:45.008547 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-a2875b82-4bc5-43a9-83c1-0ae12bc8c9d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:45.167567 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-a2875b82-4bc5-43a9-83c1-0ae12bc8c9d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:45.176477 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-a2875b82-4bc5-43a9-83c1-0ae12bc8c9d6 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1454 microversion: 2.1 time: 0.182633 Sep 01 17:50:45.177150 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 584/1129] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:44 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:45.197938 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-a9ee4970-2bf8-45ba-89f4-ba7cebd083e9 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:45.198544 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-a9ee4970-2bf8-45ba-89f4-ba7cebd083e9 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:45.205942 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9ee4970-2bf8-45ba-89f4-ba7cebd083e9 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:45.206663 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9ee4970-2bf8-45ba-89f4-ba7cebd083e9 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:45.207162 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9ee4970-2bf8-45ba-89f4-ba7cebd083e9 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:45.208006 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9ee4970-2bf8-45ba-89f4-ba7cebd083e9 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:45.208673 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9ee4970-2bf8-45ba-89f4-ba7cebd083e9 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:45.209175 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-a9ee4970-2bf8-45ba-89f4-ba7cebd083e9 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:45.356312 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-a9ee4970-2bf8-45ba-89f4-ba7cebd083e9 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:45.365262 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-a9ee4970-2bf8-45ba-89f4-ba7cebd083e9 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1454 microversion: 2.1 time: 0.171520 Sep 01 17:50:45.365906 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 546/1130] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:45 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:47.220983 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-cf57d8f0-e109-448a-b366-aa36c9cc65d8 req-e3ec139a-d684-4cc3-af67-36537366f29a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5687478d-c2aa-475a-a030-313f2f9ce8e8", "tag": "a4af03c4-ba4c-4cc5-8c49-983fb0570cd4"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:47.231509 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-cf57d8f0-e109-448a-b366-aa36c9cc65d8 req-e3ec139a-d684-4cc3-af67-36537366f29a service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:47.232098 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-cf57d8f0-e109-448a-b366-aa36c9cc65d8 req-e3ec139a-d684-4cc3-af67-36537366f29a service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:47.232609 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-cf57d8f0-e109-448a-b366-aa36c9cc65d8 req-e3ec139a-d684-4cc3-af67-36537366f29a service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:47.245433 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-cf57d8f0-e109-448a-b366-aa36c9cc65d8 req-e3ec139a-d684-4cc3-af67-36537366f29a service nova] Creating event network-changed:a4af03c4-ba4c-4cc5-8c49-983fb0570cd4 for instance 5687478d-c2aa-475a-a030-313f2f9ce8e8 on hv-cinder-83976 Sep 01 17:50:47.250752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-cf57d8f0-e109-448a-b366-aa36c9cc65d8 req-e3ec139a-d684-4cc3-af67-36537366f29a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105562 Sep 01 17:50:47.251466 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 585/1131] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:52:15.436477 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:52:15.437276 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG dbcounter [-] [127233] Writing DB stats nova_cell1:SELECT=44 {{(pid=127233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:52:15.438094 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-5e216599-ebe8-40d4-9d4f-5469524d67a8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:15.438806 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5e216599-ebe8-40d4-9d4f-5469524d67a8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:15.442139 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_api:SELECT=20 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:52:15.443044 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG dbcounter [-] [127232] Writing DB stats nova_cell1:SELECT=48 {{(pid=127232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:52:15.444117 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 17:52:15.444263 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Thu Sep 1 17:52:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 (ip 10.222.0.100) !!! Sep 01 17:52:15.446676 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 17:52:15.446829 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Thu Sep 1 17:52:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 (ip 10.222.0.100) !!! Sep 01 17:52:15.447206 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-b2983fce-6d78-43f2-b297-6f7e3147343a req-96c6ae23-ad6b-44ac-b75d-797b801258c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5687478d-c2aa-475a-a030-313f2f9ce8e8", "tag": "a4af03c4-ba4c-4cc5-8c49-983fb0570cd4"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:52:15.460032 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-b2983fce-6d78-43f2-b297-6f7e3147343a req-96c6ae23-ad6b-44ac-b75d-797b801258c6 service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:15.460750 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-b2983fce-6d78-43f2-b297-6f7e3147343a req-96c6ae23-ad6b-44ac-b75d-797b801258c6 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:15.461189 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-b2983fce-6d78-43f2-b297-6f7e3147343a req-96c6ae23-ad6b-44ac-b75d-797b801258c6 service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:15.466579 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5e216599-ebe8-40d4-9d4f-5469524d67a8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:15.466988 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5e216599-ebe8-40d4-9d4f-5469524d67a8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:15.467428 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5e216599-ebe8-40d4-9d4f-5469524d67a8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:15.468298 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5e216599-ebe8-40d4-9d4f-5469524d67a8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:15.468764 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5e216599-ebe8-40d4-9d4f-5469524d67a8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:15.469193 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-5e216599-ebe8-40d4-9d4f-5469524d67a8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:15.474625 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-b2983fce-6d78-43f2-b297-6f7e3147343a req-96c6ae23-ad6b-44ac-b75d-797b801258c6 service nova] Creating event network-changed:a4af03c4-ba4c-4cc5-8c49-983fb0570cd4 for instance 5687478d-c2aa-475a-a030-313f2f9ce8e8 on hv-cinder-83976 Sep 01 17:52:15.478330 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-b2983fce-6d78-43f2-b297-6f7e3147343a req-96c6ae23-ad6b-44ac-b75d-797b801258c6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043813 Sep 01 17:52:15.479124 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 586/1132] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:52:15.504685 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-5e216599-ebe8-40d4-9d4f-5469524d67a8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Going to try to terminate instance {{(pid=127232) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:52:15.606536 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-5e216599-ebe8-40d4-9d4f-5469524d67a8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 204 len: 0 microversion: 2.1 time: 0.173785 Sep 01 17:52:15.607836 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 547/1133] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:52:15 2022] DELETE /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:52:15.616526 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-bdd667bf-a004-4518-845c-f5fbc749e32e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:15.617210 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-bdd667bf-a004-4518-845c-f5fbc749e32e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:15.623632 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bdd667bf-a004-4518-845c-f5fbc749e32e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:15.624132 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bdd667bf-a004-4518-845c-f5fbc749e32e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:15.624562 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bdd667bf-a004-4518-845c-f5fbc749e32e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:15.625283 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bdd667bf-a004-4518-845c-f5fbc749e32e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:15.626562 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bdd667bf-a004-4518-845c-f5fbc749e32e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:15.626882 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-bdd667bf-a004-4518-845c-f5fbc749e32e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:15.884777 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-bdd667bf-a004-4518-845c-f5fbc749e32e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:52:15.892612 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-bdd667bf-a004-4518-845c-f5fbc749e32e tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1578 microversion: 2.1 time: 0.280387 Sep 01 17:52:15.894127 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 587/1134] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:15 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1578 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:52:16.915783 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-f0c79544-dbb4-4d4f-a356-071570975fba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:16.916542 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-f0c79544-dbb4-4d4f-a356-071570975fba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:16.923304 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f0c79544-dbb4-4d4f-a356-071570975fba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:16.923781 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f0c79544-dbb4-4d4f-a356-071570975fba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:16.924217 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f0c79544-dbb4-4d4f-a356-071570975fba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:16.924911 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f0c79544-dbb4-4d4f-a356-071570975fba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:16.925366 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f0c79544-dbb4-4d4f-a356-071570975fba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:16.925817 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-f0c79544-dbb4-4d4f-a356-071570975fba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:17.189113 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-f0c79544-dbb4-4d4f-a356-071570975fba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:52:17.198188 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-f0c79544-dbb4-4d4f-a356-071570975fba tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1578 microversion: 2.1 time: 0.286662 Sep 01 17:52:17.198852 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 548/1135] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:16 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1578 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:52:17.881703 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-92228c78-26e4-4da9-b8af-a541c34433f6 req-ddd0cac2-a15c-4615-9b67-f27243ae9efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5687478d-c2aa-475a-a030-313f2f9ce8e8", "name": "network-vif-deleted", "tag": "a4af03c4-ba4c-4cc5-8c49-983fb0570cd4"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:52:17.895294 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-92228c78-26e4-4da9-b8af-a541c34433f6 req-ddd0cac2-a15c-4615-9b67-f27243ae9efe service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:17.895819 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-92228c78-26e4-4da9-b8af-a541c34433f6 req-ddd0cac2-a15c-4615-9b67-f27243ae9efe service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:17.896245 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-92228c78-26e4-4da9-b8af-a541c34433f6 req-ddd0cac2-a15c-4615-9b67-f27243ae9efe service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:17.909820 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-92228c78-26e4-4da9-b8af-a541c34433f6 req-ddd0cac2-a15c-4615-9b67-f27243ae9efe service nova] Creating event network-vif-deleted:a4af03c4-ba4c-4cc5-8c49-983fb0570cd4 for instance 5687478d-c2aa-475a-a030-313f2f9ce8e8 on hv-cinder-83976 Sep 01 17:52:17.915071 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-92228c78-26e4-4da9-b8af-a541c34433f6 req-ddd0cac2-a15c-4615-9b67-f27243ae9efe service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038451 Sep 01 17:52:17.915672 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 588/1136] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:52:18.220232 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:18.220849 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:18.230778 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:18.231270 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:18.231711 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:18.232440 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:18.232898 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:18.233327 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:18.267017 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:18.267559 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:18.268030 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:18.268987 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.objects.instance [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lazy-loading 'fault' on Instance uuid 5687478d-c2aa-475a-a030-313f2f9ce8e8 {{(pid=127232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:52:18.316529 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:52:18.329091 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-cbdbc70a-8d6e-4257-acd1-cca04ea4345a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 200 len: 1233 microversion: 2.1 time: 0.112786 Sep 01 17:52:18.329665 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 549/1137] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:18 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 1233 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:52:19.351379 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-11b59f58-6938-43f8-a78b-fbb2355a7e78 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:19.352067 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-11b59f58-6938-43f8-a78b-fbb2355a7e78 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 5687478d-c2aa-475a-a030-313f2f9ce8e8] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:19.358627 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-11b59f58-6938-43f8-a78b-fbb2355a7e78 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:19.359101 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-11b59f58-6938-43f8-a78b-fbb2355a7e78 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:19.359530 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-11b59f58-6938-43f8-a78b-fbb2355a7e78 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:19.360219 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-11b59f58-6938-43f8-a78b-fbb2355a7e78 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:19.360664 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-11b59f58-6938-43f8-a78b-fbb2355a7e78 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:19.361079 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-11b59f58-6938-43f8-a78b-fbb2355a7e78 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:19.375126 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-11b59f58-6938-43f8-a78b-fbb2355a7e78 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] HTTP exception thrown: Instance 5687478d-c2aa-475a-a030-313f2f9ce8e8 could not be found. Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-11b59f58-6938-43f8-a78b-fbb2355a7e78 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Request method failure captured: Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 HTTP/1.1 Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO--5IZbmxlIGk_1Azkz4kBWOoW6N0v4hKvvS_Nl9jy8dhcMAqxoh3IYAtKyJAk_UEonBhHQy9GiP4KfgNjYclJcMVS6NnoDAXbHfmYvbMWSxwk7aCkk8gM51L0VaYa3rrph2FJ2XvjcPqxNsbeTZ1Gzqi2JiQ9PNnufQ8OUcXWtnqQ Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 2e0189e8a6ef4f2c930f0864100a9d82 Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:52:19.376752 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:52:19.378781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:52:19.378781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:52:19.378781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 2e0189e8a6ef4f2c930f0864100a9d82 Sep 01 17:52:19.378781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:52:19.378781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-TestVolumeBootPattern-1562634802-project Sep 01 17:52:19.378781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:52:19.378781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:52:19.378781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: cf0dc05b996e4aa3a1d7605028c64f30 Sep 01 17:52:19.378781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-TestVolumeBootPattern-1562634802-project Sep 01 17:52:19.378781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:52:19.378781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 5687478d-c2aa-475a-a030-313f2f9ce8e8 could not be found. Sep 01 17:52:19.378781 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '5687478d-c2aa-475a-a030-313f2f9ce8e8'} Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5687478d-c2aa-475a-a030-313f2f9ce8e8 could not be found. Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:19.379918 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5687478d-c2aa-475a-a030-313f2f9ce8e8 could not be found. Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5687478d-c2aa-475a-a030-313f2f9ce8e8 could not be found. Sep 01 17:52:19.381749 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:19.383337 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-11b59f58-6938-43f8-a78b-fbb2355a7e78 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Returning 404 to user: Instance 5687478d-c2aa-475a-a030-313f2f9ce8e8 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:19.383337 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-11b59f58-6938-43f8-a78b-fbb2355a7e78 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8" status: 404 len: 111 microversion: 2.1 time: 0.031605 Sep 01 17:52:19.383337 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 589/1138] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:19 2022] GET /compute/v2.1/servers/5687478d-c2aa-475a-a030-313f2f9ce8e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:52:22.715226 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-560e5c10-216b-48fb-bf86-df0d38bbe6d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:22.715788 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-560e5c10-216b-48fb-bf86-df0d38bbe6d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:22.717865 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-ddfbea5c-a64c-47d8-9788-42e2dbcfd6d7 req-417b17bd-8798-4ecc-8ade-844c3277d73a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1831462e-5b04-4398-a345-adddf1000d01", "tag": "97c1e60d-a1c0-4dfe-af88-ec6826948aa1"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:52:22.722320 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-560e5c10-216b-48fb-bf86-df0d38bbe6d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:22.723624 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-560e5c10-216b-48fb-bf86-df0d38bbe6d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:22.724402 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-560e5c10-216b-48fb-bf86-df0d38bbe6d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:22.725097 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-560e5c10-216b-48fb-bf86-df0d38bbe6d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:22.726130 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-560e5c10-216b-48fb-bf86-df0d38bbe6d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:22.726261 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-560e5c10-216b-48fb-bf86-df0d38bbe6d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:22.729202 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-ddfbea5c-a64c-47d8-9788-42e2dbcfd6d7 req-417b17bd-8798-4ecc-8ade-844c3277d73a service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:22.729794 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-ddfbea5c-a64c-47d8-9788-42e2dbcfd6d7 req-417b17bd-8798-4ecc-8ade-844c3277d73a service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:22.730496 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-ddfbea5c-a64c-47d8-9788-42e2dbcfd6d7 req-417b17bd-8798-4ecc-8ade-844c3277d73a service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:22.743394 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-ddfbea5c-a64c-47d8-9788-42e2dbcfd6d7 req-417b17bd-8798-4ecc-8ade-844c3277d73a service nova] Creating event network-changed:97c1e60d-a1c0-4dfe-af88-ec6826948aa1 for instance 1831462e-5b04-4398-a345-adddf1000d01 on hv-cinder-83976 Sep 01 17:52:22.749176 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-ddfbea5c-a64c-47d8-9788-42e2dbcfd6d7 req-417b17bd-8798-4ecc-8ade-844c3277d73a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035156 Sep 01 17:52:22.750151 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 590/1139] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:52:22.756058 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-560e5c10-216b-48fb-bf86-df0d38bbe6d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Going to try to terminate instance {{(pid=127232) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:52:22.852264 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-560e5c10-216b-48fb-bf86-df0d38bbe6d8 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 204 len: 0 microversion: 2.1 time: 0.140556 Sep 01 17:52:22.853751 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 550/1140] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:52:22 2022] DELETE /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:52:22.867108 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-50b312e8-f806-4989-b4d9-8c9293efc5cd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:22.868561 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-50b312e8-f806-4989-b4d9-8c9293efc5cd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:22.875323 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-50b312e8-f806-4989-b4d9-8c9293efc5cd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:22.875881 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-50b312e8-f806-4989-b4d9-8c9293efc5cd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:22.876592 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-50b312e8-f806-4989-b4d9-8c9293efc5cd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:22.877366 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-50b312e8-f806-4989-b4d9-8c9293efc5cd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:22.877946 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-50b312e8-f806-4989-b4d9-8c9293efc5cd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:22.878612 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-50b312e8-f806-4989-b4d9-8c9293efc5cd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:23.022505 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.policy [None req-50b312e8-f806-4989-b4d9-8c9293efc5cd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127233) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:52:23.030540 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-50b312e8-f806-4989-b4d9-8c9293efc5cd tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1579 microversion: 2.1 time: 0.171988 Sep 01 17:52:23.031114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 591/1141] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:22 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1579 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:52:24.053121 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-27770a50-3d77-4b88-8c54-0c8a5f0fde76 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:24.053892 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-27770a50-3d77-4b88-8c54-0c8a5f0fde76 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:24.060841 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-27770a50-3d77-4b88-8c54-0c8a5f0fde76 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:24.061436 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-27770a50-3d77-4b88-8c54-0c8a5f0fde76 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:24.061904 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-27770a50-3d77-4b88-8c54-0c8a5f0fde76 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:24.062626 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-27770a50-3d77-4b88-8c54-0c8a5f0fde76 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:24.063081 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-27770a50-3d77-4b88-8c54-0c8a5f0fde76 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:24.063498 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-27770a50-3d77-4b88-8c54-0c8a5f0fde76 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:24.247032 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-27770a50-3d77-4b88-8c54-0c8a5f0fde76 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:52:24.255314 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-27770a50-3d77-4b88-8c54-0c8a5f0fde76 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1579 microversion: 2.1 time: 0.206951 Sep 01 17:52:24.255903 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 551/1142] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:24 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1579 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:52:25.134111 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [req-1b920042-bee2-49ef-beb5-6904a4ce6199 req-d06d3a42-521d-432c-8b3e-adef3626c8bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1831462e-5b04-4398-a345-adddf1000d01", "name": "network-vif-deleted", "tag": "97c1e60d-a1c0-4dfe-af88-ec6826948aa1"}]} {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:52:25.143830 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-1b920042-bee2-49ef-beb5-6904a4ce6199 req-d06d3a42-521d-432c-8b3e-adef3626c8bb service nova] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:25.144305 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-1b920042-bee2-49ef-beb5-6904a4ce6199 req-d06d3a42-521d-432c-8b3e-adef3626c8bb service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:25.145280 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [req-1b920042-bee2-49ef-beb5-6904a4ce6199 req-d06d3a42-521d-432c-8b3e-adef3626c8bb service nova] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:25.159130 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.compute.server_external_events [req-1b920042-bee2-49ef-beb5-6904a4ce6199 req-d06d3a42-521d-432c-8b3e-adef3626c8bb service nova] Creating event network-vif-deleted:97c1e60d-a1c0-4dfe-af88-ec6826948aa1 for instance 1831462e-5b04-4398-a345-adddf1000d01 on hv-cinder-83976 Sep 01 17:52:25.165112 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [req-1b920042-bee2-49ef-beb5-6904a4ce6199 req-d06d3a42-521d-432c-8b3e-adef3626c8bb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094542 Sep 01 17:52:25.165740 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 592/1143] 10.222.0.100 () {64 vars in 1322 bytes} [Thu Sep 1 17:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:52:25.276389 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-9dbf1749-946f-488a-bdc5-513768792a20 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:25.276947 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-9dbf1749-946f-488a-bdc5-513768792a20 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:25.283299 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9dbf1749-946f-488a-bdc5-513768792a20 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:25.283780 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9dbf1749-946f-488a-bdc5-513768792a20 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:25.284253 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9dbf1749-946f-488a-bdc5-513768792a20 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:25.284989 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9dbf1749-946f-488a-bdc5-513768792a20 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:25.285983 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9dbf1749-946f-488a-bdc5-513768792a20 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:25.286656 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-9dbf1749-946f-488a-bdc5-513768792a20 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:25.355556 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.policy [None req-9dbf1749-946f-488a-bdc5-513768792a20 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf0dc05b996e4aa3a1d7605028c64f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0189e8a6ef4f2c930f0864100a9d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127232) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:52:25.363484 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-9dbf1749-946f-488a-bdc5-513768792a20 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 200 len: 1227 microversion: 2.1 time: 0.090846 Sep 01 17:52:25.364930 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 552/1144] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:25 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 1227 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:52:26.387095 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d1f564ed-0483-4777-89c4-bc1175fc6053 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:26.387976 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-d1f564ed-0483-4777-89c4-bc1175fc6053 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 1831462e-5b04-4398-a345-adddf1000d01] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:26.396455 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d1f564ed-0483-4777-89c4-bc1175fc6053 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:26.397046 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d1f564ed-0483-4777-89c4-bc1175fc6053 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:26.397492 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d1f564ed-0483-4777-89c4-bc1175fc6053 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:26.398246 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d1f564ed-0483-4777-89c4-bc1175fc6053 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:26.398706 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d1f564ed-0483-4777-89c4-bc1175fc6053 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:26.399125 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-d1f564ed-0483-4777-89c4-bc1175fc6053 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:26.414788 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-d1f564ed-0483-4777-89c4-bc1175fc6053 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] HTTP exception thrown: Instance 1831462e-5b04-4398-a345-adddf1000d01 could not be found. Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d1f564ed-0483-4777-89c4-bc1175fc6053 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Request method failure captured: Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 HTTP/1.1 Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO--5IZbmxlIGk_1Azkz4kBWOoW6N0v4hKvvS_Nl9jy8dhcMAqxoh3IYAtKyJAk_UEonBhHQy9GiP4KfgNjYclJcMVS6NnoDAXbHfmYvbMWSxwk7aCkk8gM51L0VaYa3rrph2FJ2XvjcPqxNsbeTZ1Gzqi2JiQ9PNnufQ8OUcXWtnqQ Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 2e0189e8a6ef4f2c930f0864100a9d82 Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:52:26.416450 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:52:26.418268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:52:26.418268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:52:26.418268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 2e0189e8a6ef4f2c930f0864100a9d82 Sep 01 17:52:26.418268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:52:26.418268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-TestVolumeBootPattern-1562634802-project Sep 01 17:52:26.418268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:52:26.418268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:52:26.418268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: cf0dc05b996e4aa3a1d7605028c64f30 Sep 01 17:52:26.418268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-TestVolumeBootPattern-1562634802-project Sep 01 17:52:26.418268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:52:26.418268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 1831462e-5b04-4398-a345-adddf1000d01 could not be found. Sep 01 17:52:26.418268 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '1831462e-5b04-4398-a345-adddf1000d01'} Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1831462e-5b04-4398-a345-adddf1000d01 could not be found. Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:26.419287 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1831462e-5b04-4398-a345-adddf1000d01 could not be found. Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1831462e-5b04-4398-a345-adddf1000d01 could not be found. Sep 01 17:52:26.421140 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.422628 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-d1f564ed-0483-4777-89c4-bc1175fc6053 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Returning 404 to user: Instance 1831462e-5b04-4398-a345-adddf1000d01 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:26.422628 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-d1f564ed-0483-4777-89c4-bc1175fc6053 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01" status: 404 len: 111 microversion: 2.1 time: 0.035725 Sep 01 17:52:26.422628 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 593/1145] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:26 2022] GET /compute/v2.1/servers/1831462e-5b04-4398-a345-adddf1000d01 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:52:26.909818 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-046faeb0-82cc-4bec-a310-59b776bdcc0f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:26.910377 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.compute.api [None req-046faeb0-82cc-4bec-a310-59b776bdcc0f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127232) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:26.917378 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-046faeb0-82cc-4bec-a310-59b776bdcc0f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:26.917901 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-046faeb0-82cc-4bec-a310-59b776bdcc0f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:26.918336 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-046faeb0-82cc-4bec-a310-59b776bdcc0f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:26.919034 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-046faeb0-82cc-4bec-a310-59b776bdcc0f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:26.919484 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-046faeb0-82cc-4bec-a310-59b776bdcc0f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:26.920173 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG oslo_concurrency.lockutils [None req-046faeb0-82cc-4bec-a310-59b776bdcc0f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:26.937825 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.wsgi [None req-046faeb0-82cc-4bec-a310-59b776bdcc0f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] HTTP exception thrown: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-046faeb0-82cc-4bec-a310-59b776bdcc0f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Request method failure captured: Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: request: DELETE /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 HTTP/1.1 Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept: application/json Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Accept-Encoding: identity Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Connection: close Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Length: 0 Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Content-Type: application/json Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Host: 10.222.0.100 Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: Openstack-System-Scope: None Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Auth-Token: gAAAAABjEO--5IZbmxlIGk_1Azkz4kBWOoW6N0v4hKvvS_Nl9jy8dhcMAqxoh3IYAtKyJAk_UEonBhHQy9GiP4KfgNjYclJcMVS6NnoDAXbHfmYvbMWSxwk7aCkk8gM51L0VaYa3rrph2FJ2XvjcPqxNsbeTZ1Gzqi2JiQ9PNnufQ8OUcXWtnqQ Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Id: None Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Domain-Name: None Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Identity-Status: Confirmed Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Is-Admin-Project: True Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Id: default Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Domain-Name: Default Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Id: 2e0189e8a6ef4f2c930f0864100a9d82 Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Project-Name: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Role: reader,member Sep 01 17:52:26.939503 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Roles: reader,member Sep 01 17:52:26.941499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:52:26.941499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:52:26.941499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Id: 2e0189e8a6ef4f2c930f0864100a9d82 Sep 01 17:52:26.941499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-Tenant-Name: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:52:26.941499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User: tempest-TestVolumeBootPattern-1562634802-project Sep 01 17:52:26.941499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Id: default Sep 01 17:52:26.941499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Domain-Name: Default Sep 01 17:52:26.941499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Id: cf0dc05b996e4aa3a1d7605028c64f30 Sep 01 17:52:26.941499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: X-User-Name: tempest-TestVolumeBootPattern-1562634802-project Sep 01 17:52:26.941499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: method: > Sep 01 17:52:26.941499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: exception: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:52:26.941499 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: action_args: {'id': '11eb423a-f3d8-4e02-8a41-b64a46503d39'} Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:26.943968 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:52:26.946220 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.947853 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-046faeb0-82cc-4bec-a310-59b776bdcc0f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Returning 404 to user: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. {{(pid=127232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:26.947853 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-046faeb0-82cc-4bec-a310-59b776bdcc0f tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "DELETE /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 404 len: 111 microversion: 2.1 time: 0.035169 Sep 01 17:52:26.947853 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 553/1146] 10.222.0.100 () {58 vars in 1244 bytes} [Thu Sep 1 17:52:26 2022] DELETE /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:52:26.950388 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-284e3a19-ad9f-438a-8e7b-43df41161e68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '>' {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:26.951007 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.compute.api [None req-284e3a19-ad9f-438a-8e7b-43df41161e68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] [instance: 11eb423a-f3d8-4e02-8a41-b64a46503d39] Fetching instance by UUID {{(pid=127233) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:26.958114 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-284e3a19-ad9f-438a-8e7b-43df41161e68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:26.959029 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-284e3a19-ad9f-438a-8e7b-43df41161e68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:26.959029 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-284e3a19-ad9f-438a-8e7b-43df41161e68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:26.959755 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-284e3a19-ad9f-438a-8e7b-43df41161e68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Acquiring lock "2e69bc69-0465-4e2e-a814-7702ef293021" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:26.960209 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-284e3a19-ad9f-438a-8e7b-43df41161e68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:26.960633 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG oslo_concurrency.lockutils [None req-284e3a19-ad9f-438a-8e7b-43df41161e68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Lock "2e69bc69-0465-4e2e-a814-7702ef293021" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:26.975702 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.wsgi [None req-284e3a19-ad9f-438a-8e7b-43df41161e68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] HTTP exception thrown: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-284e3a19-ad9f-438a-8e7b-43df41161e68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Request method failure captured: Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: request: GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 HTTP/1.1 Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept: application/json Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Accept-Encoding: identity Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Connection: close Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Length: 0 Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Content-Type: application/json Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Host: 10.222.0.100 Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: Openstack-System-Scope: None Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Auth-Token: gAAAAABjEO--5IZbmxlIGk_1Azkz4kBWOoW6N0v4hKvvS_Nl9jy8dhcMAqxoh3IYAtKyJAk_UEonBhHQy9GiP4KfgNjYclJcMVS6NnoDAXbHfmYvbMWSxwk7aCkk8gM51L0VaYa3rrph2FJ2XvjcPqxNsbeTZ1Gzqi2JiQ9PNnufQ8OUcXWtnqQ Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Id: None Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Domain-Name: None Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Identity-Status: Confirmed Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Is-Admin-Project: True Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Id: default Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Domain-Name: Default Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Id: 2e0189e8a6ef4f2c930f0864100a9d82 Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Project-Name: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Role: reader,member Sep 01 17:52:26.977262 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Roles: reader,member Sep 01 17:52:26.978987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2e0189e8a6ef4f2c930f0864100a9d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}] Sep 01 17:52:26.978987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:52:26.978987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Id: 2e0189e8a6ef4f2c930f0864100a9d82 Sep 01 17:52:26.978987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-Tenant-Name: tempest-TestVolumeBootPattern-1562634802 Sep 01 17:52:26.978987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User: tempest-TestVolumeBootPattern-1562634802-project Sep 01 17:52:26.978987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Id: default Sep 01 17:52:26.978987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Domain-Name: Default Sep 01 17:52:26.978987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Id: cf0dc05b996e4aa3a1d7605028c64f30 Sep 01 17:52:26.978987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: X-User-Name: tempest-TestVolumeBootPattern-1562634802-project Sep 01 17:52:26.978987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: method: > Sep 01 17:52:26.978987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: exception: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:52:26.978987 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: action_args: {'id': '11eb423a-f3d8-4e02-8a41-b64a46503d39'} Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: {{(pid=127233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:26.979887 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. Sep 01 17:52:26.981551 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.983143 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: DEBUG nova.api.openstack.wsgi [None req-284e3a19-ad9f-438a-8e7b-43df41161e68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Returning 404 to user: Instance 11eb423a-f3d8-4e02-8a41-b64a46503d39 could not be found. {{(pid=127233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:26.983143 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: INFO nova.api.openstack.requestlog [None req-284e3a19-ad9f-438a-8e7b-43df41161e68 tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39" status: 404 len: 111 microversion: 2.1 time: 0.032347 Sep 01 17:52:26.983143 dv-cinder-839768-6-iscsi devstack@n-api.service[127233]: [pid: 127233|app: 0|req: 594/1147] 10.222.0.100 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:26 2022] GET /compute/v2.1/servers/11eb423a-f3d8-4e02-8a41-b64a46503d39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:52:28.293272 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: DEBUG nova.api.openstack.wsgi [None req-fa0435e1-2e92-46f2-8da7-7f9038fd114a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] Calling method '.version_select at 0x7f354a70ad30>' {{(pid=127232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:28.328480 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: INFO nova.api.openstack.requestlog [None req-fa0435e1-2e92-46f2-8da7-7f9038fd114a tempest-TestVolumeBootPattern-1562634802 tempest-TestVolumeBootPattern-1562634802-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-398492581" status: 202 len: 0 microversion: 2.1 time: 0.039278 Sep 01 17:52:28.329069 dv-cinder-839768-6-iscsi devstack@n-api.service[127232]: [pid: 127232|app: 0|req: 554/1148] 10.222.0.100 () {58 vars in 1265 bytes} [Thu Sep 1 17:52:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-398492581 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)